본문 바로가기

Programming/Bash

if you want to split a large csv file into several smaller ones, just use 'split' in shell.

I have a large csv file(10Gb). But it's too large to process on a program. 


There is a way to solve this problem. You can use bash command 'split'. Just take a look at an example below.


$ split -l 100 data.csv

this command will separate data.csv into every 100 lines with a lot of files. It's so simple.