Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Read metadata directly (method has been removed). #34

Closed
wants to merge 1 commit into from
Closed

Read metadata directly (method has been removed). #34

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion tests/hipscat/io/test_write_metadata_cloud.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,11 @@
import hipscat.pixel_math as hist
import numpy.testing as npt
import pyarrow as pa
import pyarrow.parquet as pq
import pytest
from hipscat.catalog.catalog_info import CatalogInfo
from hipscat.io import file_io
from hipscat.io.file_io.file_io import get_fs
from hipscat.io.parquet_metadata import write_parquet_metadata

from hipscat_cloudtests import assert_text_file_matches
Expand Down Expand Up @@ -175,7 +177,8 @@ def check_parquet_schema(file_name, expected_schema, expected_num_row_groups=1,

assert schema.equals(expected_schema, check_metadata=False)

parquet_file = file_io.read_parquet_file(file_pointer=file_name, storage_options=storage_options)
file_system, file_pointer = get_fs(file_name, storage_options=storage_options)
parquet_file = pq.ParquetFile(file_pointer, filesystem=file_system)
assert parquet_file.metadata.num_row_groups == expected_num_row_groups

for row_index in range(0, parquet_file.metadata.num_row_groups):
Expand Down
Loading