Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. The Lounge
  3. 26GB text file

26GB text file

Scheduled Pinned Locked Moved The Lounge
question
43 Posts 22 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • T Tim Ranker

    del How useful could it be anyways? :)

    J Offline
    J Offline
    John M Drescher
    wrote on last edited by
    #23

    I just wanted to see what recent operation was causing the log to balloon out of control.. John

    1 Reply Last reply
    0
    • J Jorgen Sigvardsson

      How long do you think such an import would take? :rolleyes: :-D -- Gnnnnmmmpppppppfffffhhh!

      D Offline
      D Offline
      Daniel Turini
      wrote on last edited by
      #24

      Jörgen Sigvardsson wrote: How long do you think such an import would take? I've done such imports on about an hour. Indexing will take another one. Querying will be instantaneous. Now, try two or three 26GB searches with a text editor. :-D Talking about large data, DBMS is still one of the best tools.

      // Quantum sort algorithm implementation
      while (!sorted)
      ;

      J 1 Reply Last reply
      0
      • D Daniel Turini

        Jörgen Sigvardsson wrote: How long do you think such an import would take? I've done such imports on about an hour. Indexing will take another one. Querying will be instantaneous. Now, try two or three 26GB searches with a text editor. :-D Talking about large data, DBMS is still one of the best tools.

        // Quantum sort algorithm implementation
        while (!sorted)
        ;

        J Offline
        J Offline
        Jorgen Sigvardsson
        wrote on last edited by
        #25

        Thanks for the idea. I've never thought about using a database this way before. :) -- Gnnnnmmmpppppppfffffhhh!

        1 Reply Last reply
        0
        • B Bijesh

          You'll probably be better off writing your own program to read the last few lines and write in in another file.. Visual Studio just gives up if the file is too big... --------------------------------------------------

          J Offline
          J Offline
          John M Drescher
          wrote on last edited by
          #26

          I just found that out. Here is the error message: An unknown error has occurred while accessing an unnamed file. John

          B 1 Reply Last reply
          0
          • L lsauer

            well actually total commander internal lister (F3). The only possible solutions, as far as reading only goes. The advantage is that it takes virtually no resources and 0 loading time or that stuff it streames dynamically, so size is just limited by your HD and OS but not by this app.

            L Offline
            L Offline
            leppie
            wrote on last edited by
            #27

            I totally agree. Fastest viewer by far :) leppie::AllocCPArticle(Generic DFA State Machine for .NET);

            1 Reply Last reply
            0
            • J John M Drescher

              I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

              D Offline
              D Offline
              David Wulff
              wrote on last edited by
              #28

              Right click it and choose print, then bring out your favourite coloured marker...


              David Wulff

              Not all teenagers smoke and drink. I gave up smoking years ago.

              J L 2 Replies Last reply
              0
              • D David Wulff

                Right click it and choose print, then bring out your favourite coloured marker...


                David Wulff

                Not all teenagers smoke and drink. I gave up smoking years ago.

                J Offline
                J Offline
                John M Drescher
                wrote on last edited by
                #29

                :laugh: :laugh: :laugh: :omg: John

                1 Reply Last reply
                0
                • J John M Drescher

                  I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                  J Offline
                  J Offline
                  John M Drescher
                  wrote on last edited by
                  #30

                  I knew it was a database problem so I stopped the system and put a breakpoint where the error was being logged and I found out the database was missing an essential record. After adding the record all was well, but I must not assume a query returns a record from now on... {EDIT] Good thing I keep a copy of the complete source code tree of the current running executable... [/EDIT] John

                  1 Reply Last reply
                  0
                  • J John M Drescher

                    I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                    A Offline
                    A Offline
                    Anders Molin
                    wrote on last edited by
                    #31

                    Notepad ;) Ok, serious, I think Visual Studio should be able to handle it... - Anders Money talks, but all mine ever says is "Goodbye!" http://SourceLocker.net[^] SourceControl and DefectTracker Project.

                    J 1 Reply Last reply
                    0
                    • A Anders Molin

                      Notepad ;) Ok, serious, I think Visual Studio should be able to handle it... - Anders Money talks, but all mine ever says is "Goodbye!" http://SourceLocker.net[^] SourceControl and DefectTracker Project.

                      J Offline
                      J Offline
                      John M Drescher
                      wrote on last edited by
                      #32

                      Anders Molin wrote: I think Visual Studio should be able to handle it... I tried that and got the following error message: An unknown error has occurred while accessing an unnamed file. John

                      A 1 Reply Last reply
                      0
                      • J John M Drescher

                        I just found that out. Here is the error message: An unknown error has occurred while accessing an unnamed file. John

                        B Offline
                        B Offline
                        Bijesh
                        wrote on last edited by
                        #33

                        Well thats good, cause mine just gives up silently after doing something for some time :~ --------------------------------------------------

                        1 Reply Last reply
                        0
                        • D Daniel Turini

                          UNIX tools use longs for file positioning and don't support files > 4GB.

                          // Quantum sort algorithm implementation
                          while (!sorted)
                          ;

                          S Offline
                          S Offline
                          Shog9 0
                          wrote on last edited by
                          #34

                          Even when it works, the command i gave would've only shown him the last 10 lines. I was expressing my amazement at his need more than offering a valid solution.

                          Shog9

                          Let your mercy spill / On all these burning hearts in hell If it be your will / To make us well...

                          1 Reply Last reply
                          0
                          • D David Wulff

                            Right click it and choose print, then bring out your favourite coloured marker...


                            David Wulff

                            Not all teenagers smoke and drink. I gave up smoking years ago.

                            L Offline
                            L Offline
                            Lost User
                            wrote on last edited by
                            #35

                            And a palette truck to move the printout :omg: The tigress is here :-D

                            1 Reply Last reply
                            0
                            • J John M Drescher

                              Anders Molin wrote: I think Visual Studio should be able to handle it... I tried that and got the following error message: An unknown error has occurred while accessing an unnamed file. John

                              A Offline
                              A Offline
                              Anders Molin
                              wrote on last edited by
                              #36

                              Not good X| - Anders Money talks, but all mine ever says is "Goodbye!" http://SourceLocker.net[^] SourceControl and DefectTracker Project.

                              1 Reply Last reply
                              0
                              • J John M Drescher

                                I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                                R Offline
                                R Offline
                                Richard Jones
                                wrote on last edited by
                                #37

                                Just print it out and read it tonight.:-D Facts do not cease to exist because they are ignored Aldous Huxley (1894 - 1963)

                                J 1 Reply Last reply
                                0
                                • R Richard Jones

                                  Just print it out and read it tonight.:-D Facts do not cease to exist because they are ignored Aldous Huxley (1894 - 1963)

                                  J Offline
                                  J Offline
                                  John M Drescher
                                  wrote on last edited by
                                  #38

                                  I don't even want to know how long that will take to print... John

                                  1 Reply Last reply
                                  0
                                  • J John M Drescher

                                    I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                                    B Offline
                                    B Offline
                                    bart sawyer
                                    wrote on last edited by
                                    #39

                                    As already mentioned the internal lister of Total Commander handles test files of several GBs without any problem (it's an viewer, not an editor). One of the many wonderful features of the tool :) bart

                                    J 1 Reply Last reply
                                    0
                                    • J John M Drescher

                                      I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                                      O Offline
                                      O Offline
                                      Olli
                                      wrote on last edited by
                                      #40

                                      John M. Drescher wrote: I have a 26GB logfile that was produced by my program Oh my god.......:eek: How many years do you think you read the log... :omg: :omg: But serious, when your program did write so much text, can't you write a short peace of code to read from the end??? I think it's too hard stuff for most editors....

                                      Olli "Ooooooh, they have the internet on computers now!"
                                      Homer Simpson
                                      :beer: + :java: = NULL :=> X|

                                      J 1 Reply Last reply
                                      0
                                      • O Olli

                                        John M. Drescher wrote: I have a 26GB logfile that was produced by my program Oh my god.......:eek: How many years do you think you read the log... :omg: :omg: But serious, when your program did write so much text, can't you write a short peace of code to read from the end??? I think it's too hard stuff for most editors....

                                        Olli "Ooooooh, they have the internet on computers now!"
                                        Homer Simpson
                                        :beer: + :java: = NULL :=> X|

                                        J Offline
                                        J Offline
                                        John M Drescher
                                        wrote on last edited by
                                        #41

                                        Thanks. I was able to see what I wanted by copying the log deleting it and restarting the program. Through a debug I found out exactly what was causing the problem and it now is fixed... John

                                        1 Reply Last reply
                                        0
                                        • B bart sawyer

                                          As already mentioned the internal lister of Total Commander handles test files of several GBs without any problem (it's an viewer, not an editor). One of the many wonderful features of the tool :) bart

                                          J Offline
                                          J Offline
                                          John M Drescher
                                          wrote on last edited by
                                          #42

                                          This is a replacement DOS shell?? I use an old version of 4NT. John

                                          B 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups