Charlie2015Malayalam1080pBluRayDTSx2648GBESubs
.Q:
Importing a JSON file to Python using pyarrow
I have a JSON file that I'm trying to import to Pyarrow.
I'm trying to use the format shown in the docs.
While it says to use json.loads, I'm getting a ValueError: No JSON object could be decoded.
Here's a part of the file:
{
"data": [{
"username": "foo",
"firstname": "bar",
"age": 40,
"website": "foobar.com"
}, {
"username": "foo2",
"firstname": "bar2",
"age": 41,
"website": "foobar2.com"
}],
"keys": [1, 2]
}
Here's my code:
def load(db):
ctxt = pyarrow.ParquetConverter(db.format_name)
path = "example/out.parquet"
with open(path) as f:
with pyarrow.Table.from_file(f, format="json") as table:
with pyarrow.ParquetFile(path) as pf:
ctxt.convert(pf, table)
This error is being thrown by the converter:
File "/usr/local/lib/python3.7/site-packages/pyarrow/json_converter.py", line 178, in _convert_types
if not is_nested_dict:
File "/usr/local/lib/python3.7/site-packages/pyarrow/util/type.py", line 84, in is_nested_dict
self._is_dict(value) and ac619d1d87
Related links: