Hi guys, I was wondering if there is any impact of the Memory (private working set) towards the performance of the windows services. I developed a Windows Service program in C#. Basically what it does is, reading an unstructured text file and then converting it to a structured text file. File size ranging 1GB to 2GB per file, in multi-threaded. As what I noted, the higher the Memory (private working set) from the Task manager; it goes, the poorer the program to read and write file. I already troubleshooting and recode the program in any ways. Still no luck Any comments to the above, very much appreciated. Thanks

Thank you and sorry for the wrong site posting. :laugh:

Hi guys, I need some advice on the a reporting application. I have some text files which needed to be displayed on a web application. I have a requirement that all these text files are required to be kept in a repository database and to be displayed as in pdf format, on the web. The text files are not in a fixed format. some may A4 paper size and some may A3, A2 and so forth. There are two separate process/program. -one for the file format conversion + store in to the repository -the other, is the web application, mainly just to display the source. Which approach should I proceed? a) convert these files to pdf and store them in to the repository and then, display them on the web. b) store the files (without conversion) and then convert to pdf before display them on the web. Thank you for your comment.

Hi many thanks for the recommendation. any free SDK or API to use? my main object is I highlight the text in the pdf. I hit a button, it captures the coordinate of it.. I could not find much information pertaining the axAcroPDF. Thanks

Hi Eventually, I did I used Adobe PDF Reader object in the form itself (axAcroPDF). I open the pdf file in this object. and then I create the MouseUp, MouseDown and MouseDrag event. It only can detects outer layer of the pdf object. It could not detect the pdf inside.. That's why i want to get some advise, is there any alternative. Thanks

Hi, Is there a way for select multiple pdf area with mouse and get it's coordinates using c#? Thank you in advance

understand. thanks

Hi, Actually our company wants to develop something similar to COLD system. But in generically .... we are building a new product based to this concept....

I had an assumption that programming could do 'almost' wonderful things. for example: I have a file sized 10 MB. This special program shrinks down the size by ~30% (7MB for example) and then store it in to a container. What i mean by OS handling is unlike a normal compression and store them into a folder.

I get what you mean : )

Yes, However, we need to further shrinking down the file size and better file handling. Instead of OS handling.

Many thanks. But this process only works at the end of the document status. I do not think it would be able to append more files after been compressed and segmented the files I have a requirement too, which additional files can be added to after the above compression and segmentation.

Hi, What do you mean by overkill? This HDFS has its limitation and does not locate the processing logic power? I have no personal experience to this product As per summarized: Hadoop is an Apache Software Foundation distributed file system and data management project with goals for storing and managing large amounts of data. Hadoop uses a storage system called HDFS to connect commodity personal computers, known as nodes, contained within clusters over which data blocks are distributed. You can access and store the data blocks as one seamless file system using the MapReduce processing model. HDFS shares many common features with other distributed file systems while supporting some important differences. One significant difference is HDFS's write-once-read-many model that relaxes concurrency control requirements, simplifies data coherency, and enables high-throughput access. In order to provide an optimized data-access model, HDFS is designed to locate processing logic near the data rather than locating data near the application space. It sounds promising.

I have found the solution by this product: Hadoop Distributed File System (HDFS™): A distributed file system that provides high-throughput access to application data. Thanks :)

Hi, I just want to compress the files and package them into one container for a configurable size. Any idea of doing the packaging?(not zipping)

Hi Thanks Chill for the reply. It's undecided yet. either using .Net or Java. Dependent on complexity and ease of the job. I will pick up some info on Kernel Transaction Manager. However, does this KTM works fine with >600 GB to Terabyte files? Any issue or constraint it might have? Should there be other recommendation? I'm afraid my management may decide to reside the application on UNIX or other platform than Windows. Then I will be in trouble of revamping the core program.

Storing huge files without database Hi, I'm at my wits end. I just need some idea/brain storming here with the expert/professional. Scenario, I have 30 text files. (each files about 300mb-500mb) What i need to do is to convert these files into some sort of binary and store it some where. But not in SQL database. I have an intention to store these files into 'look alike' container. for example. I have container A and container B every each container has a cap size of 1GB. each and every text files will move into this container (until the quota reach) Once reach, it will move to container B, and so on ...to C, D, E.... On top of that, I will have an application to locate back these files too. Any medium/container that i can use for this purpose? Thanks