Reducing RAM usage when re-enumerating symbol columns - KX Learning Hub

kdb+

Reducing RAM usage when re-enumerating symbol columns

Posted by eohara_kdb on February 7, 2024 at 12:00 am

Hi,

Is there a method to re-enumerate symbol columns in a splayed table without loading in the entire column file? This is part of a data copy between two HDBs, and we want to avoid pulling the entire column into memory if possible. Looked at using 1: (File Binary | Reference | kdb+ and q documentation – Kdb+ and q documentation (kx.com)) to load, re-enumerate and write the column in chunks but haven’t managed to get it working.

Thanks,

Eoghan

eohara_kdb replied 8 months, 2 weeks ago 2 Members · 1 Reply
1 Reply

jfealy

Member
February 7, 2024 at 12:00 am

This might be of use – be sure to test first

https://github.com/jfealy/q/blob/master/mergeHdb.q

Log In to Reply

Log in to reply.