26GB text file
-
How long do you think such an import would take? :rolleyes: :-D -- Gnnnnmmmpppppppfffffhhh!
Jörgen Sigvardsson wrote: How long do you think such an import would take? I've done such imports on about an hour. Indexing will take another one. Querying will be instantaneous. Now, try two or three 26GB searches with a text editor. :-D Talking about large data, DBMS is still one of the best tools.
// Quantum sort algorithm implementation
while (!sorted)
; -
Jörgen Sigvardsson wrote: How long do you think such an import would take? I've done such imports on about an hour. Indexing will take another one. Querying will be instantaneous. Now, try two or three 26GB searches with a text editor. :-D Talking about large data, DBMS is still one of the best tools.
// Quantum sort algorithm implementation
while (!sorted)
;Thanks for the idea. I've never thought about using a database this way before. :) -- Gnnnnmmmpppppppfffffhhh!
-
You'll probably be better off writing your own program to read the last few lines and write in in another file.. Visual Studio just gives up if the file is too big... --------------------------------------------------
I just found that out. Here is the error message: An unknown error has occurred while accessing an unnamed file. John
-
well actually total commander internal lister (F3). The only possible solutions, as far as reading only goes. The advantage is that it takes virtually no resources and 0 loading time or that stuff it streames dynamically, so size is just limited by your HD and OS but not by this app.
I totally agree. Fastest viewer by far :) leppie::AllocCPArticle(Generic DFA State Machine for .NET);
-
I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John
Right click it and choose print, then bring out your favourite coloured marker...
David Wulff
Not all teenagers smoke and drink. I gave up smoking years ago.
-
Right click it and choose print, then bring out your favourite coloured marker...
David Wulff
Not all teenagers smoke and drink. I gave up smoking years ago.
:laugh: :laugh: :laugh: :omg: John
-
I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John
I knew it was a database problem so I stopped the system and put a breakpoint where the error was being logged and I found out the database was missing an essential record. After adding the record all was well, but I must not assume a query returns a record from now on... {EDIT] Good thing I keep a copy of the complete source code tree of the current running executable... [/EDIT] John
-
I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John
Notepad ;) Ok, serious, I think Visual Studio should be able to handle it... - Anders Money talks, but all mine ever says is "Goodbye!" http://SourceLocker.net[^] SourceControl and DefectTracker Project.
-
Notepad ;) Ok, serious, I think Visual Studio should be able to handle it... - Anders Money talks, but all mine ever says is "Goodbye!" http://SourceLocker.net[^] SourceControl and DefectTracker Project.
Anders Molin wrote: I think Visual Studio should be able to handle it... I tried that and got the following error message: An unknown error has occurred while accessing an unnamed file. John
-
I just found that out. Here is the error message: An unknown error has occurred while accessing an unnamed file. John
-
UNIX tools use longs for file positioning and don't support files > 4GB.
// Quantum sort algorithm implementation
while (!sorted)
;Even when it works, the command i gave would've only shown him the last 10 lines. I was expressing my amazement at his need more than offering a valid solution.
Shog9
Let your mercy spill / On all these burning hearts in hell If it be your will / To make us well...
-
Right click it and choose print, then bring out your favourite coloured marker...
David Wulff
Not all teenagers smoke and drink. I gave up smoking years ago.
And a palette truck to move the printout :omg: The tigress is here :-D
-
Anders Molin wrote: I think Visual Studio should be able to handle it... I tried that and got the following error message: An unknown error has occurred while accessing an unnamed file. John
Not good X| - Anders Money talks, but all mine ever says is "Goodbye!" http://SourceLocker.net[^] SourceControl and DefectTracker Project.
-
I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John
Just print it out and read it tonight.:-D Facts do not cease to exist because they are ignored Aldous Huxley (1894 - 1963)
-
Just print it out and read it tonight.:-D Facts do not cease to exist because they are ignored Aldous Huxley (1894 - 1963)
I don't even want to know how long that will take to print... John
-
I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John
As already mentioned the internal lister of Total Commander handles test files of several GBs without any problem (it's an viewer, not an editor). One of the many wonderful features of the tool :) bart
-
I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John
John M. Drescher wrote: I have a 26GB logfile that was produced by my program Oh my god.......:eek: How many years do you think you read the log... :omg: :omg: But serious, when your program did write so much text, can't you write a short peace of code to read from the end??? I think it's too hard stuff for most editors....
Olli "Ooooooh, they have the internet on computers now!"
Homer Simpson
:beer: + :java: = NULL :=> X| -
John M. Drescher wrote: I have a 26GB logfile that was produced by my program Oh my god.......:eek: How many years do you think you read the log... :omg: :omg: But serious, when your program did write so much text, can't you write a short peace of code to read from the end??? I think it's too hard stuff for most editors....
Olli "Ooooooh, they have the internet on computers now!"
Homer Simpson
:beer: + :java: = NULL :=> X|Thanks. I was able to see what I wanted by copying the log deleting it and restarting the program. Through a debug I found out exactly what was causing the problem and it now is fixed... John
-
As already mentioned the internal lister of Total Commander handles test files of several GBs without any problem (it's an viewer, not an editor). One of the many wonderful features of the tool :) bart
This is a replacement DOS shell?? I use an old version of 4NT. John
-
This is a replacement DOS shell?? I use an old version of 4NT. John
John M. Drescher wrote: This is a replacement DOS shell?? I use an old version of 4NT. No, a replacement for the windows explorer. with (among other things) archiving, filecompare, ftp... Great tool, I couldn't do without anymore. The internal lister was the only tool that opened multiple GB log files in seconds and allowed workable searches in it. http://www.ghisler.com[^] bart