[FEA] custom kernel for URI/URL parsing

[revans2]

Is your feature request related to a problem? Please describe.

NVIDIA/spark-rapids#8761 added URL parsing (Actually URI parsing, spark made the switch a while ago on the backend), but to do it we had to make a regular expression that is crazy big. A lot of that size comes from trying to be IPv6 Compatible. Really we should write a custom kernel to save memory, and performance.

https://www.rfc-editor.org/rfc/rfc2396 describes the official syntax, but we could probably find/use another Apache licensed URI parser like https://github.com/apache/commons-vfs/blob/master/commons-vfs2/src/main/java/org/apache/commons/vfs2/provider/UriParser.java

Tasks

Preview Give feedback

1. Implement HOST url parsing as part of parse_url support #1500
   +0
   
2. Implement PROTOCOL url parsing as part of parse_url support #1501
   enhancement +1
   
3. Implement PATH url parsing #1585
   +0
4. Implement QUERY url parsing #1650
   3 of 3
   +0
   
5. Implement REF url parsing
6. Implement FILE url parsing
7. Implement AUTHORITY url parsing
8. Implement USERINFO url parsing

[thirtiseven]

Here is a direct translation of the URL parsing part of the Java URI lib to C++ that might help this issue.

Deleted the gist as it is not allowed by the license.

[revans2]

Here is a direct translation of the URL parsing part of the Java URI lib to C++ that might help this issue.

We cannot use that code. The java code is under a GPL license with a classpath exception. Our license is Apache. The two are not compatible with each other. Do not copy any of the java or code from the GIST url above to the kernel we produce or we will have to write it over again from scratch.

[hyperbolic2346]

These have been implemented.