Re: Trouble With Huge CSVs

[rocuinneagain]

Yes the w32 version has a limit to how much memory it can address, w64 does not have this restriction.

 

You could also stream the data to an on disk table:

.Q.fs[{`:trade/ upsert flip colnames!("**********";",")0:x}]`:filename
trade:get `:trade/

• https://kx.com/blog/kx-product-insights-parsing-data-in-kdb/
• https://code.kx.com/q/kb/splayed-tables/