HDF5VOL
  1. HDF5VOL

PNETCDF-VOL

Public
AuthorCommitMessageCommit dateIssues
Quincey KoziolQuincey Koziol
0e8b8c63ca3Move repo to https://github.com/hpc-io/vol-pnetcdf.git
Huihuo ZhengHuihuo Zheng
4e78c68804fchanged dates
Huihuo ZhengHuihuo Zheng
19e88c765dbadded Huihuo
Richard James ZamoraRichard James Zamora
fbaa517b8fado update 3
Richard James ZamoraRichard James Zamora
d25cfa22b51second documentation update
Richard James ZamoraRichard James Zamora
a996dd95d7edocumentation progress
Richard James ZamoraRichard James Zamora
310b64cc155cleanup and new documentation progress
Richard James ZamoraRichard James Zamora
860b391ff80correcting submission script errors
Richard James ZamoraRichard James Zamora
c3a99c727c7still need to add option in H5VL_cdf_dataset_get to return the variable type, but code/test is otherwise working nicely on my Mac. There may be issues on Theta/etc, but we are in a good place for a decent documentation draft.
Richard James ZamoraRichard James Zamora
e3651f1fc17vol_test.c now allows the user to use double-precision arrays (using the --double flag).
Richard James ZamoraRichard James Zamora
c90e21803e6code now works with hyperslab selctions on record variables (multiple record variables are allowed - as are mix of record and non-record variables)
Richard James ZamoraRichard James Zamora
5906f1d3b2anow reading record variables correctly -- now only need to address cases with multiple record variables (stride between records). This may only require changes to the construction of the dimension-multiplier array (mm). The multiplier for the first dimension can just be set to the record stride distance.
Richard James ZamoraRichard James Zamora
efcc0cb7530added necessary file-view reset
Richard James ZamoraRichard James Zamora
1f476cfd8f3woriking on record variable support with hyperslab selections -- may be able to adjust test to use correct process mapping, then just modify the dimension multiplyer used to calculate the position in source, etc..
Richard James ZamoraRichard James Zamora
9ac30cae497created the cdf_select_all_read helper funtion to avoid reusing code
Richard James ZamoraRichard James Zamora
f30b3127b5cadding record-variable reading for ALL selections in hdf5 -- still need to add capability to hyperslab selection. Should also add optimized pathway for simple hyperslab mappings (current approach is more general than it needs to be in many cases).
Richard James ZamoraRichard James Zamora
7b65f3f811ccan now write and read record variables with pnetcdf - just need to add read to cdfvl code.
Richard James ZamoraRichard James Zamora
efb069e978fstarting to add record-variable support
Richard James ZamoraRichard James Zamora
7d8f602e25cadding file-open timer back in to check scaling of header-parsing code
Richard James ZamoraRichard James Zamora
4ab24859061adding additional loop to submission script
Richard James ZamoraRichard James Zamora
0c820a352d9prepared for production tests on Theta
Richard James ZamoraRichard James Zamora
8dd200c4ac3ready to add submission script for theta scaling
Richard James ZamoraRichard James Zamora
bba5f325e12refactored benchmark progress - working, but need to reorder vol read to time all variables together
Richard James ZamoraRichard James Zamora
b72c0515038refactor -- update 2
Richard James ZamoraRichard James Zamora
bdf56beb8f4refactor progress - update 1
Richard James ZamoraRichard James Zamora
bcbfa5939b3corrections after testing on Theta debug queue - fixing use of MPI_Dims_create etc.
Richard James ZamoraRichard James Zamora
8f8f537acd8adding simple API for user to get file metadata (outside HDF5 API) -- This is just a stopgap functionality addition
Richard James ZamoraRichard James Zamora
dc1bac7889fadding ability to open and read an attribute BY NAME ONLY.Still need to add functionality for user to inspect file (determine the attributes and variables in the file).
Richard James ZamoraRichard James Zamora
356b3d3e766Cleanup of benchmark/test and VOL code.Next steps are to improve VOL API support and test performance on Theta.
Richard James ZamoraRichard James Zamora
29962b56163hyperslab selection is improved (and allows for MPI and POSIX-based IO).Still need to clean up and add functionality to read attributes and query metadata.
Richard James ZamoraRichard James Zamora
7c4bbb29df6Replaced hyperslab selection with code from the ADIOS VOL - The code should be more flexible now, but the assignToMemSpace call seems to be wrong - need to check if the benchmark is actually the part that is wrong (is the memory hyperslab selection correct?).
Richard James ZamoraRichard James Zamora
941d3e3387dvery simple hyperslab selection is working for single blocks into a single contiguous buffer - complex mapping between selections is not supported.
Richard James ZamoraRichard James Zamora
925b25e6f06progress toward hyperslab selection, etc
Richard James ZamoraRichard James Zamora
dce9e2e3162adding H5VL_cdf_dataset_get cakkback to allow user-app to get storagesize
Richard James ZamoraRichard James Zamora
728d2bb137acorrecting strcmp test mistake
Richard James ZamoraRichard James Zamora
dd347bb1637simple H5S_SEL_ALL integer example working
Richard James ZamoraRichard James Zamora
3b78e38f70dworking on H5S_SEL_ALL dataset read
Richard James ZamoraRichard James Zamora
bcb593111efProgress - Metadata is read through a cache that is read by rank 0 and then broadcasted to the other processes.The current version of the code should scale reasonably well (but the H5VL_CDF_CACHE_SIZE parameter will determine the performance).
Richard James ZamoraRichard James Zamora
9c5053c2b82comment cleanup and ENABLE_CDF_VERBOSE addition for print statements
Richard James ZamoraRichard James Zamora
8e875447f06CDF VOL will now parse typical file header correctly - Just need to clean up the implementation and tackle serial data access next (then parallel data access)
Richard James ZamoraRichard James Zamora
ba87b943a84saving further progress for parsing the CDF header. Currently working on the variable metadata
Richard James ZamoraRichard James Zamora
6cdddde8ac3more progress for parsing header
Richard James ZamoraRichard James Zamora
3a086a342b6adding functionality to read CDF header in CDF VOL
Richard James ZamoraRichard James Zamora
1c276275f11adding pnetcdf code to test
Richard James ZamoraRichard James Zamora
1a7c425127fremoving object files
Richard James ZamoraRichard James Zamora
b99a5f4426dstarting a simplistic CDF VOL
Richard James ZamoraRichard James Zamora
f16463b847ainitial commit of pnetcdf_vol - I am including an adios example as a template that I can play with