I’d like to test different inputs to a pyspark regex to see if they fail/succeed before previewing/running a build. Is there a site/testing tool that exists for this purpose?
>Solution :
You can downsample your input using the Preview functionality in Authoring, where you can then specify a filter you want to craft your input for testing.
Then, you can run your PySpark code on this custom sample to verify it does what you expect.
You click on the gear in the following view after clicking the Preview button.
Then, you can describe what sample you want.
After you have this, running your regex on your input will be fast and easy to test.