• kdb+

  Reducing RAM usage when re-enumerating symbol columns

  Posted by eohara_kdb on February 7, 2024 at 12:00 am

  Hi,

  Is there a method to re-enumerate symbol columns in a splayed table without loading in the entire column file? This is part of a data copy between two HDBs, and we want to avoid pulling the entire column into memory if possible. Looked at using 1: (File Binary | Reference | kdb+ and q documentation – Kdb+ and q documentation (kx.com)) to load, re-enumerate and write the column in chunks but haven’t managed to get it working.

  Thanks,

  Eoghan

  eohara_kdb replied 2 months, 1 week ago 2 Members · 1 Reply
• 1 Reply

• 

  jfealy

  Member

  February 7, 2024 at 12:00 am

  This might be of use – be sure to test first

  https://github.com/jfealy/q/blob/master/mergeHdb.q

Log In to Reply