-
Notifications
You must be signed in to change notification settings - Fork 483
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add blog for OpenSearchCon 2024 NA #3450
Changes from 19 commits
e7f0f48
f75cc2e
c80a677
06f3bd5
7151d41
c85fad2
fde5ce6
ebd1d91
d68f052
7bde121
f6a51d7
05cfecb
575ac76
15aae5d
ca3a465
eaa2554
596db94
d1afb27
ff2f9e9
a07a65e
0578136
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,51 @@ | ||
--- | ||
layout: post | ||
title: "OpenSearchCon 2024: North America -- The blog post" | ||
authors: | ||
- prthsh | ||
- smelik | ||
date: 2024-11-14 | ||
categories: | ||
- community-updates | ||
- community | ||
- updates | ||
- update | ||
- partners | ||
meta_keywords: OpenSearchCon, OpenSearch Project, Adobe, Linux Foundation, GenAI, Vector Search, OpenSearch Software Foundation, Airbnb, Lucene, Cloud, OpenSearch Serverless, Uber, Slack, OpenSearchCon North America | ||
meta_description: | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Please update the meta with the following: meta_keywords: OpenSearch Project, OpenSearchCon 2024, search and analytics, open-source, AI, machine learning, data-driven applications, cloud-native, community-driven, Linux Foundation meta_description: Explore the key highlights, insightful sessions, and exciting announcements from the OpenSearchCon North America 2024. Learn about the OpenSearch Project, new features, community growth, and about the roadmap for 2024 and beyond. |
||
excerpt: OpenSearch, the community-driven, open-source search and analytics suite, has been gaining momentum in the data-driven application landscape. The recent OpenSearchCon North America 2024 event held in San Francisco, which attracted over 350 attendees from around the world, was a testament to the growing influence of this powerful platform. In this blog post, we'll explore the key highlights, insightful sessions, and exciting announcements that emerged from this year's conference. | ||
--- | ||
|
||
|
||
1. Introduction | ||
OpenSearch, the community-driven, open-source search and analytics suite, has been gaining momentum in the data-driven application landscape. The recent ![OpenSearchCon 2024: North America](https://opensearch.org/events/opensearchcon/2024/north-america/index.html) event held in San Francisco, which attracted over 350 attendees from around the world, was a testament to the growing influence of this powerful platform. In this blog post, we'll explore the key highlights, insightful sessions, and exciting announcements that emerged from this year's conference. | ||
|
||
2. Keynote: The future of OpenSearch | ||
|
||
The event kicked off with an inspiring keynote from Eli Fisher, Sr. Manager, Product Management at OpenSearch, who laid out the vision for the future of OpenSearch. Some key announcements included: | ||
|
||
* OpenSearch 2.x and unlocking AI potential: Eli shared details about the OpenSearch 2.x release, including features like the OpenSearch AI toolkit, a built-in retrieval-augmented generation (RAG) processor, and concurrent segment search, unlocking new possibilities for AI-powered applications. | ||
* OpenSearch generative AI use cases: Anupam Chaturvedi, Adobe Engineering Manager, demonstrated how Adobe is leveraging OpenSearch for its Acrobat generative AI assistant, showcasing the practical applications of OpenSearch in the generative AI space. | ||
* Community growth: Jim Zemlin, Executive Director, ![The Linux Foundation](https://www.linuxfoundation.org/), spoke about welcoming OpenSearch to the Linux Foundation. By opening up project governance and moving to a neutral home, the OpenSearch Project is taking concrete steps to further the project's founding principle of being for the community and by the community. | ||
|
||
3. Important sessions and workshops | ||
The conference featured several informative sessions and workshops, including: | ||
|
||
* Session: ![Airbnb Embedding Platform](https://www.youtube.com/watch?v=kpWQ55hVF90) | ||
This session, led by Moutupsi Paul, Xiaotang Wang, and Amulya Sharma, focused on how Airbnb is leveraging OpenSearch as a vector database for its embedding platform. The session provided an overview of how Airbnb is using vector embeddings to solve guest, host, and marketplace challenges, followed by specific use cases that led Airbnb to adopt OpenSearch as its vector database. The session shared lessons learned and provided insights into strategies for optimizing OpenSearch as a vector database. | ||
* Session: ![Lucene And Beyond - Core Storage Extension In OpenSearch](https://youtu.be/-_mXJqvPw0o?si=7Lb1Y__uAZ7ZCc66) | ||
OpenSearch is tightly bound to the Lucene core APIs that facilitate encoding, transactions, merges, and search. This session, led by Samuel Herman, focused on how OpenSearch storage encoding can be extended to popular formats (for example, Parquet, Avro) that are readable by public big data systems such as Apache Spark. | ||
* Session: ![Bringing cloud native innovation from search platforms at Uber and Slack into OpenSearch](https://youtu.be/iZrFVqvTD9s?si=loButiXx8zm2PHob) | ||
This session, led by Karthikeyan Ramasamy and Bryan Burkholder, showcased how their organizations' unique requirements of low-latency, high-throughput workloads led them to develop their own search and log analytics platforms, making it easy to operate, cost effective, and able to scale to petabytes of data. The session covered how Uber and Slack are collaborating with the OpenSearch Project to bring some of their learnings and innovations from their platforms into OpenSearch, with a special focus on a modular cloud-native architecture featuring isolation between readers and writers and a performant messaging protocol for communication between services. | ||
* Session: ![A deep dive into OpenSearch Serverless](https://www.youtube.com/watch?v=JPo_uF4Fw4M) | ||
This session, led by Rohit Nair and Milav Shah, dives deep into how Amazon OpenSearch Serverless works, including architecture details, understanding performance and operational characteristics, and the future roadmap. | ||
|
||
natebower marked this conversation as resolved.
Show resolved
Hide resolved
|
||
4. Closing remarks: What's next for OpenSearch? | ||
|
||
The event was not just about technical sessions—it was also a fantastic opportunity to network with peers in the open-source search space. The community lounge was buzzing with activity, and there were plenty of informal meetups where attendees could connect with OpenSearch engineers, contributors, and advocates. | ||
|
||
As the OpenSearchCon event drew to a close, it was clear that the conference was a significant milestone for the OpenSearch community. The announcements about new features, improvements in observability, and the ongoing commitment to open-source principles left attendees excited about the future of the project. | ||
|
||
The OpenSearch roadmap for 2024 highlights key themes around which contributors are innovating, including stability, availability, and resiliency (StAR); cost, performance, and scale (CoPS); ease of use; observability and log analytics; search and machine learning (ML); security; and a modular architecture. | ||
|
||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Line 51: Should we provide a link to the events page that we invite the reader to bookmark? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @natebower - this one https://opensearch.org/events/? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. @prthsh2020 I think so, but maybe have @pajuric confirm. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Change made |
||
As the OpenSearch Project continues to grow, the community is streamlining the process of creating a roadmap that includes ideas and projects provided directly by the community. It's clear that the project is poised to make an even bigger impact in the world of AI/ML, search, and observability. We will be back in 2025 with three different OpenSearchCon events, including in Europe, India, and North America. You can bookmark the [Upcoming Events](https://opensearch.org/events/) page and consider attending one of the project's bi-weekly ![meetups](https://www.meetup.com/opensearch/) or an in-person ![user group](https://www.meetup.com/pro/opensearchproject/). We encourage you to try out OpenSearch, engage with the community, and stay tuned for the exciting developments to come. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Update to today's date - 2024-12-5