You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug unexpected_index_query returned by the validation result can not be used to get the failed rows unless formatted properly
To Reproduce
Run any expectation in COMPLETE mode to get the unexpected_index_query in the result
Expected behavior unexpected_index_query returned by the validation result should be in a proper usable format
"unexpected_index_query": "df.filter(F.expr(NOT (ID Number IS NOT NULL)))" can be formatted and used as follows: "unexpected_index_query": "df.filter(F.expr('NOT (``ID Number`` IS NOT NULL)'))"
Similarly, "unexpected_index_query": "df.filter(F.expr((Country IS NOT NULL) AND (NOT (Country IN (US, GB, Algeria)))))" can be formatted and used as follows: "unexpected_index_query": "df.filter(F.expr('(Country IS NOT NULL) AND (NOT (Country IN (\"US\", \"GB\", \"Algeria\")))'))"
Environment (please complete the following information):
Great Expectations Version: [1.3.5]
Data Source: [PySpark DataFrame]
Cloud environment: [Azure Databricks]
The text was updated successfully, but these errors were encountered:
@suchintakp5 Thanks for reaching out! This has come up before, and it's on our radar for consideration and prioritization. I’ll share any updates as soon as I have more info. Thanks again
Describe the bug
unexpected_index_query
returned by the validation result can not be used to get the failed rows unless formatted properlyTo Reproduce
Run any expectation in COMPLETE mode to get the
unexpected_index_query
in the resultExpected behavior
unexpected_index_query
returned by the validation result should be in a proper usable format"unexpected_index_query": "df.filter(F.expr(NOT (ID Number IS NOT NULL)))"
can be formatted and used as follows:"unexpected_index_query": "df.filter(F.expr('NOT (``ID Number`` IS NOT NULL)'))"
Similarly,
"unexpected_index_query": "df.filter(F.expr((Country IS NOT NULL) AND (NOT (Country IN (US, GB, Algeria)))))"
can be formatted and used as follows:"unexpected_index_query": "df.filter(F.expr('(Country IS NOT NULL) AND (NOT (Country IN (\"US\", \"GB\", \"Algeria\")))'))"
Environment (please complete the following information):
The text was updated successfully, but these errors were encountered: