Additional Database Support?

[jwilder123]

Any plans on adding support for Sql Server, MailEntityProcessor, etc?

[jmdeleon]

I would imagine most databases would be supported via SqlEntityProcessor if there is a proper JDBC driver available.

I have been able to successfully get the current data-import-handler-8.6.0.jar to work under Solr 8.9, creating an index out of CSV files using the CSVJDBC - CSV file JDBC driver (https://sourceforge.net/projects/csvjdbc/):

Here is my example configuration:

https://github.com/jmdeleon/dih-csv-jdbc-8

Why use the CSV JDBC driver with DataImportHandler instead of the built-in Solr CSV importers? It was/is much more flexible to use tools available in DIH like TemplateTransformer and ScriptTransformer to process CSV rows and fields, and you could eventually replace the CSV file with a proper database, moving from prototype to production-scale data sets.

[jwilder123]

That's awesome! Any chance you have any interest in the below? I have no Java experience =( https://docs.microsoft.com/en-us/sql/connect/jdbc/microsoft-jdbc-driver-for-sql-server?view=sql-server-ver15

…

On Fri, Aug 20, 2021 at 2:36 PM jmdeleon ***@***.***> wrote: I would imagine most databases would be supported if there is a proper JDBC driver available. I have been able to successfully get the current data-import-handler-8.6.0.jar to work under Solr 8.9, creating an index out of CSV files using the CSVJDBC - CSV file JDBC driver ( https://sourceforge.net/projects/csvjdbc/): Here is my example configuration: https://github.com/jmdeleon/dih-csv-jdbc-8 Why use the CSV JDBC driver with DataImportHandler instead of the built-in Solr CSV importers? It was/is much more flexible to use tools available in DIH like TemplateTransformer and ScriptTransformer to process CSV rows and fields, and you could eventually replace the CSV file with a proper database, moving from prototype to production-scale data sets. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#22 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AB3EDHIA5MQO7L2JJPN2XCLT52OBLANCNFSM4WIQIBZQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email> .

[jmdeleon]

You can look over the configuration in my dih-csv-jdbc-8 repo, specifically the solrconfig.xml in the conf directory. I load the csvjdbc-XXX.jar JDBC driver file and the data-import-handler-XXX.jar file from the solrconfig.xml file. I imagine you'd have to set up a similar JDBC driver JAR file for SQL Server and adapt the SQL query (and subsequent column references) in the db-data-config.xml and schema.xml files for your purposes.

[jwilder123]

Thanks for the tip! Will do On Aug 20, 2021, at 3:39 PM, jmdeleon ***@***.***> wrote:  You can look over the configuration in my dih-csv-jdbc-8 repo, specifically the solrconfig.xml in the conf directory. I load the csvjdbc-XXX.jar JDBC driver file and the data-import-handler-XXX.jar file from the solrconfig.xml file. I imagine you'd have to set up a similar JDBC driver JAR file for SQL Server and adapt the SQL query in the db-data-config.xml file for your purposes. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.

[chatman]

Any plans on adding support for Sql Server, MailEntityProcessor, etc?

That would be great. Patches/PR welcome.