You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Support es_SV (El Salvador) locale in PersonSampler / managed datasets #862
I'd like to help with es_SV. I checked the official El Salvador dataset and current main 4bb221eb before starting.
The public dataset exists, but its Dataset Viewer schema lacks first_name, last_name, and locale, which the current person-record pipeline requires. The CLI also downloads prepared NGC resources rather than that raw Hugging Face dataset. Adding the locale to the constants alone would therefore leave the managed data path unresolved.
Is there a prepared es_SV.parquet/NGC artifact and an intended field mapping to use? With that confirmed, I can cover locale metadata, download/list behavior, sampling validation, and regression tests. Could a maintainer triage this if that contribution is wanted?
Thanks for looking into this and flagging the prepared dataset requirements! The prepared NGC assets are now available, and we already have PR #1136 open to add support for both El Salvador (es_SV) and Vietnam (vi_VN): #1136.
Activity
ting-hong-shieh commentedon Oct 28, 2026
I'd like to help with
es_SV. I checked the official El Salvador dataset and current main4bb221ebbefore starting.The public dataset exists, but its Dataset Viewer schema lacks
first_name,last_name, andlocale, which the current person-record pipeline requires. The CLI also downloads prepared NGC resources rather than that raw Hugging Face dataset. Adding the locale to the constants alone would therefore leave the managed data path unresolved.Is there a prepared
es_SV.parquet/NGC artifact and an intended field mapping to use? With that confirmed, I can cover locale metadata, download/list behavior, sampling validation, and regression tests. Could a maintainer triage this if that contribution is wanted?nabinchha commentedon Nov 6, 2026
Thanks for looking into this and flagging the prepared dataset requirements! The prepared NGC assets are now available, and we already have PR #1136 open to add support for both El Salvador (
es_SV) and Vietnam (vi_VN): #1136.