DEV Community

Cover image for Integrating Elasticsearch with Spark
Abinaya Ramaswamy
Abinaya Ramaswamy

Posted on

Integrating Elasticsearch with Spark

Integrating Elasticsearch with Apache Spark for Data Processing and Querying - Abinaya Ramaswamy (Data Engineer)

I got a chance to host a session which explains the integration of Elasticsearch with Apache Spark, focusing on how to write Spark data frames to Elasticsearch and perform searches using specific columns from Spark data frames. I have also dived into a use case I worked on for creating a query template with 'should' and 'must' clauses to search for specific column values from Elasticsearch.

{https://www.youtube.com/watch?v=J6FIyhXRGXg}

Top comments (0)