pytables
Issue for insert using psycopg
I am reading dat开发者_JAVA技巧a from a .mat file using the Pytables module. After reading the data, I want to insert this data into the database using psycopg.[详细]
2023-04-11 13:44 分类:问答Floating Point Exception with Numpy and PyTables
I have a rather large HDF5 file generated by PyTables that I a开发者_运维问答m attempting to read on a cluster. I am running into a problem with NumPy as I read in an individual chunk. Let\'s go with[详细]
2023-04-10 01:21 分类:问答Appending large amount of data to a tables (HDF5) database where database.numcols != newdata.numcols?
I am trying to append a large dataset (>30Gb) to an existing pytables table.The table is N columns, and the dataset is N-1 columns; one column is calculated after I know the other N-1 columns.[详细]
2023-04-02 18:47 分类:问答PyTables vs. SQLite3 insertion speed
I bought Kibot\'s stock data and it is enormous.I have about 125,000,000 rows to load (1000 stocks * 125k rows/stock [1-minute bar data since 2010-01-01], each stock in a CSV file whose fields are Dat[详细]
2023-03-07 18:01 分类:问答What is the most elegant way of selecting a subset of columns using pytables?
I have a dataset with 300+ columns in pytables, and I want to be able to choose different subsets easily.There doesn\'t seem to be a very elegant solution to this, or is there something I\'m missing?[详细]
2023-03-06 10:20 分类:问答How do I remove hex values in a python string with regular expressions?
I have a cell array in matlab columns = {\'MagX\', \'MagY\', \'MagZ\', ... \'AccelerationX\',\'AccelerationX\',\'AccelerationX\', ...[详细]
2023-02-15 01:34 分类:问答Storing and reloading large multidimensional data sets in Python
I\'m going to be running a large number of simulations producing a large amount of data that needs to be stored and accessed again later. Output data from my simulation program is written to text file[详细]
2023-02-12 09:48 分类:问答PyTables batch get and update
I have daily stock data as an HDF5 file created using PyTables. I would like to get a group of rows, process it as an array and then write it back to disk (update rows) using PyTables. I couldn\'t fig[详细]
2023-02-11 14:07 分类:问答Is there a way to store PyTable columns in a specific order?
It seems that the PyTable columns are alphabetically ordered when using both dictionary or class for schema definition for the call to createTable(). My need is to establish a specific order and then[详细]
2023-01-28 12:19 分类:问答merging 2 hdf5 files with pytables
ptrepack is almost what i want except that it only has the options to overwrite or ignore duplicate paths. the example below illustrates what i want to happen with the structures[详细]
2023-01-28 07:25 分类:问答