Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. The Lounge
  3. 26GB text file

26GB text file

Scheduled Pinned Locked Moved The Lounge
question
43 Posts 22 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J John M Drescher

    I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

    L Offline
    L Offline
    l a u r e n
    wrote on last edited by
    #5

    :wtf:


    "penguins have no bill"
    biz stuff   about me

    1 Reply Last reply
    0
    • J John M Drescher

      I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

      R Offline
      R Offline
      Radoslav Bielik
      wrote on last edited by
      #6

      :eek: Now that will be a loooooooooooooooooooong read :laugh: Rado

      J 1 Reply Last reply
      0
      • J John M Drescher

        I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

        J Offline
        J Offline
        Jorgen Sigvardsson
        wrote on last edited by
        #7

        vim :) -- Gnnnnmmmpppppppfffffhhh!

        1 Reply Last reply
        0
        • J John M Drescher

          I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

          L Offline
          L Offline
          lsauer
          wrote on last edited by
          #8

          well actually total commander internal lister (F3). The only possible solutions, as far as reading only goes. The advantage is that it takes virtually no resources and 0 loading time or that stuff it streames dynamically, so size is just limited by your HD and OS but not by this app.

          L 1 Reply Last reply
          0
          • J John M Drescher

            I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

            B Offline
            B Offline
            Brian Delahunty
            wrote on last edited by
            #9

            Ok.. notepad is out of the question. Regards, Brian Dela :-)

            1 Reply Last reply
            0
            • S Shog9 0

              >tail hugefile.txt

              Shog9

              Let your mercy spill / On all these burning hearts in hell If it be your will / To make us well...

              D Offline
              D Offline
              Daniel Turini
              wrote on last edited by
              #10

              UNIX tools use longs for file positioning and don't support files > 4GB.

              // Quantum sort algorithm implementation
              while (!sorted)
              ;

              J S 2 Replies Last reply
              0
              • R Radoslav Bielik

                :eek: Now that will be a loooooooooooooooooooong read :laugh: Rado

                J Offline
                J Offline
                John M Drescher
                wrote on last edited by
                #11

                I really want to only look at the end. It is an error log and I can see that there are a few database errors. The thing is that the system is working as expected... John

                1 Reply Last reply
                0
                • D David Cunningham

                  :omg: David

                  J Offline
                  J Offline
                  John M Drescher
                  wrote on last edited by
                  #12

                  That was my reaction when I found out that the log file was eating up the entire system partition. I'm glad I did not put it on the data partition it would have another 100GB to go... John

                  1 Reply Last reply
                  0
                  • J John M Drescher

                    I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                    A Offline
                    A Offline
                    Atlantys
                    wrote on last edited by
                    #13

                    :eek: The kindest thing you can do for a stupid person, and for the gene pool, is to let him expire of his own dumb choices. [Roger Wright on stupid people]

                    1 Reply Last reply
                    0
                    • J John M Drescher

                      I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                      T Offline
                      T Offline
                      Ted Ferenc
                      wrote on last edited by
                      #14

                      edlin in a "DOS" box!


                      If I have seen further it is by standing on the shoulders of Giants. - Isaac Newton 1676

                      1 Reply Last reply
                      0
                      • J John M Drescher

                        I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                        B Offline
                        B Offline
                        Bijesh
                        wrote on last edited by
                        #15

                        You'll probably be better off writing your own program to read the last few lines and write in in another file.. Visual Studio just gives up if the file is too big... --------------------------------------------------

                        J 1 Reply Last reply
                        0
                        • J John M Drescher

                          I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                          D Offline
                          D Offline
                          Daniel Turini
                          wrote on last edited by
                          #16

                          Import it via DTS/BCP/SQL*Loader (each line is a record), create a full text search index, and run SQL queries to find the info you need. And next time, create more manageable log files :)

                          // Quantum sort algorithm implementation
                          while (!sorted)
                          ;

                          J J 2 Replies Last reply
                          0
                          • D Daniel Turini

                            Import it via DTS/BCP/SQL*Loader (each line is a record), create a full text search index, and run SQL queries to find the info you need. And next time, create more manageable log files :)

                            // Quantum sort algorithm implementation
                            while (!sorted)
                            ;

                            J Offline
                            J Offline
                            John M Drescher
                            wrote on last edited by
                            #17

                            Daniel Turini wrote: And next time, create more manageable log files I'll be working on the fix for that ASAP... John

                            1 Reply Last reply
                            0
                            • D Daniel Turini

                              Import it via DTS/BCP/SQL*Loader (each line is a record), create a full text search index, and run SQL queries to find the info you need. And next time, create more manageable log files :)

                              // Quantum sort algorithm implementation
                              while (!sorted)
                              ;

                              J Offline
                              J Offline
                              Jorgen Sigvardsson
                              wrote on last edited by
                              #18

                              How long do you think such an import would take? :rolleyes: :-D -- Gnnnnmmmpppppppfffffhhh!

                              J D 2 Replies Last reply
                              0
                              • D Daniel Turini

                                UNIX tools use longs for file positioning and don't support files > 4GB.

                                // Quantum sort algorithm implementation
                                while (!sorted)
                                ;

                                J Offline
                                J Offline
                                Jorgen Sigvardsson
                                wrote on last edited by
                                #19

                                Depends on what UNIX. Most modern ones have been upgraded to use 64 bit positions. Of course, YMMV with SCO.. :) -- Gnnnnmmmpppppppfffffhhh!

                                1 Reply Last reply
                                0
                                • J Jorgen Sigvardsson

                                  How long do you think such an import would take? :rolleyes: :-D -- Gnnnnmmmpppppppfffffhhh!

                                  J Offline
                                  J Offline
                                  John M Drescher
                                  wrote on last edited by
                                  #20

                                  :omg: It took me forever (> 30 minutes) just to copy the file to a RAID 0 array... John

                                  1 Reply Last reply
                                  0
                                  • J John M Drescher

                                    I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                                    T Offline
                                    T Offline
                                    Tim Ranker
                                    wrote on last edited by
                                    #21

                                    del How useful could it be anyways? :)

                                    J 1 Reply Last reply
                                    0
                                    • J John M Drescher

                                      I have a 26GB logfile that was produced by my program. What is the best free text editor to read such a file?? John

                                      S Offline
                                      S Offline
                                      Scott Lee
                                      wrote on last edited by
                                      #22

                                      Quick... Someone tell me approximately how man mallocs were used during the creation of such a file. :-D

                                      1 Reply Last reply
                                      0
                                      • T Tim Ranker

                                        del How useful could it be anyways? :)

                                        J Offline
                                        J Offline
                                        John M Drescher
                                        wrote on last edited by
                                        #23

                                        I just wanted to see what recent operation was causing the log to balloon out of control.. John

                                        1 Reply Last reply
                                        0
                                        • J Jorgen Sigvardsson

                                          How long do you think such an import would take? :rolleyes: :-D -- Gnnnnmmmpppppppfffffhhh!

                                          D Offline
                                          D Offline
                                          Daniel Turini
                                          wrote on last edited by
                                          #24

                                          Jörgen Sigvardsson wrote: How long do you think such an import would take? I've done such imports on about an hour. Indexing will take another one. Querying will be instantaneous. Now, try two or three 26GB searches with a text editor. :-D Talking about large data, DBMS is still one of the best tools.

                                          // Quantum sort algorithm implementation
                                          while (!sorted)
                                          ;

                                          J 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups