Pandas

Learn how to overcome unexpected memory consumption when loading Parquet files with dictionary columns into Pandas DataFrames, and discover a simple solution to drastically reduce memory usage.

For a long time, I had in mind to write a post on visualizing GPS trajectory data. To my surprise, it’s difficult to find a couple of data samples online that you can quickly use for some data analysis.

I often work with sensor measurements such as those from car CAN-bus. These measurements are often collected over multiple sessions, but rarely these sessions are indicated by a proper identifier. Sometimes timestamps (containing date and time) are available and one can infer based on the time interval between the recordings.