pykx pandas.read_html() fails to convert string to html table - KX Learning Hub

Tagged: html, kdb, pandas, pykx

PyKX

pykx pandas.read_html() fails to convert string to html table

Posted by user931206 on May 20, 2024 at 4:09 pm
Hi

I have started using pykx within my kdb system .

Here’s the issue:

(see the photo. something went wrong with the code editor)
I cannot seem to be able to post an example html table, but it fails with any (you can generate a basic one on chatgpt).

This code works well with old embedPy.
Any ideas ?
- This discussion was modified 1 month ago by user931206.
- This discussion was modified 1 month ago by user931206.
- This discussion was modified 1 month ago by user931206.
- This discussion was modified 1 month ago by user931206.
rocuinneagain replied 1 month ago 2 Members · 1 Reply
- html
- kdb
- pandas
- pykx
1 Reply

rocuinneagain

Member
May 21, 2024 at 9:12 am
PyKX converts a q CharVector to Python NumPy array of bytes by default.

https://code.kx.com/pykx/2.5/pykx-under-q/upgrade.html#functional-differences
```
q).pykx.eval["lambda x: print(type(x))"][test];
<class 'numpy.ndarray'>

q).pykx.eval["lambda x: print(x)"][test];
[b'<' b't' b'a' b'b' b'l' b'e' b'>' b'<' b't' b'r' b'>' b'<' b't' b'h' ...
```
You can create a helper to convert to strings as you require:
```
q)b2s:.pykx.eval["lambda x: x.tobytes().decode('UTF-8')"]
q).pykx.print pd[`:read_html]b2s[test]

[  First Name Last Name  Age
0       John       Doe   30
1       Jane     Smith   25
2      Emily     Jones   22]
```
More info on default conversions:

https://code.kx.com/pykx/2.5/pykx-under-q/intro.html#function-argument-types

And:

https://code.kx.com/pykx/2.5/user-guide/fundamentals/text.html
- This reply was modified 1 month ago by rocuinneagain.

Log In to Reply

Log in to reply.