CSV splitter (divide large CSV files)

[fisherchong]

Originally Posted by scorpion

I've just written the CSV Splitter for you, as I think it might come in handy someday.

Download: csv-splitter-1.1.zip
Downloaded: 1398 times (Oct 18 2007)

I've attached the compiled exe along with source code. To run the exe, you will need .Net Framework Version 1.1 installed in prior.

Instructions:

1. Fill in necessary information:
CSV file: the path to the CSV that you wanted to split.
Number of lines: the maximum number of lines/rows in each splitted piece.
Max Pieces: limit the number of output files. '0' is unlimited.

2. Click "Split Now!", and that's it. You can find the splitted pieces in the a new folder of the same directory of the CSV file.

Scorpion i downloaded the file and ran it but the GUI doesn't have any buttons , it only shown CSV file bar , number of lines bar and max pieces bar ..... no buttons allow me to choose path and no "split now" button also. Do u have any ideas of why it happened ?

[scorpion]

I have no idea how that could happen. I downloaded it and the buttons are there. I double checked the code, and there's not a single line that is about hiding buttons.

Can you take a screenshot? It might offer some clue.

[Mad_Mitch]

Scorpion - great tool. Just curious if there is a file size limit. I have a CSV file that is 1.3GB with about 2million rows. When I try and use the splitter, it runs for a second and reports the split was successful; however, only one file is created with only one row. When I run it on smaller files, it works great. Any advice would be appreciated. Thanks again.

Originally Posted by scorpion

I've just written the CSV Splitter for you, as I think it might come in handy someday.

Download: csv-splitter-1.1.zip
Downloaded: 1398 times (Oct 18 2007)

I've attached the compiled exe along with source code. To run the exe, you will need .Net Framework Version 1.1 installed in prior.

Instructions:

1. Fill in necessary information:
CSV file: the path to the CSV that you wanted to split.
Number of lines: the maximum number of lines/rows in each splitted piece.
Max Pieces: limit the number of output files. '0' is unlimited.

2. Click "Split Now!", and that's it. You can find the splitted pieces in the a new folder of the same directory of the CSV file.

[RanneR]

I just wanted to say thanks this solves 98% of my problem. Most of my CSV files do not have a header row. If you could add a header row option I have about 500 people that could use it.

RanneR

[fisherchong]

Hi,

I've downloaded the App but after i ran the CSV file output value number 1 keeps duplicated to second files.
Anyone can help me solve ? Even i have changed the for loop below:

For i As Integer = 2 To LineCount
'For z As Integer = 0 To WriteLine(z)

Dim s As String = Reader.ReadLine()
If s <> Nothing And _IsAbort = False Then
Writer.WriteLine(s)
Else
Writer.Flush()
Writer.Close()
Exit Do
End If

Next


Still can not , the first value still duplicated to second files.

[fisherchong]

Thanks i manage to get my program runs well already , thank scorpion.