Skip to content

Commit

Permalink
Merge pull request #2513
Browse files Browse the repository at this point in the history
Complete remaining opensearchcon2023 videos
  • Loading branch information
nateynateynate authored Dec 28, 2023
2 parents 632a80d + 971acdb commit 398327d
Show file tree
Hide file tree
Showing 27 changed files with 30 additions and 1 deletion.
3 changes: 3 additions & 0 deletions _sass/_redesign-conference.scss
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,9 @@ $content-panel-expand-breakpoint: 1019px;

.landing-page-content__right-panel.conference-speaker-session-page {
background: unset;
> .conference-speaker-session-page--embedded-video {
padding: 40px 40px 80px 80px;
}
.landing-page-content__right-panel--content--body {
@media screen and (max-width: $content-panel-collapse-breakpoint) {
padding: 20px 0 0 20px;
Expand Down
1 change: 1 addition & 0 deletions _speaker_sessions/abrown_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ session_time: "2023-09-27 - 4:30pm-5:10pm"
session_room: "Redwood"
session_track: "Community"
permalink: '/events/opensearchcon/sessions/community-inclusion.html'
youtube_video_id: 'V_TtC02kjOc'
---

The belief in education as an equalizer contrasts with research showing rising U.S. economic inequality influencing educational mobility, especially for vulnerable groups. Rooted in various life spheres including education, housing, and welfare, this disparity significantly affects socio-political and economic areas. Personal experience underlines the power of parental and children's education in curbing generational poverty. With my seven years of homelessness during college, I saw a lack of community equity strategies. Educational institutions can champion social justice, improve outcomes, and break the cycle of disadvantage.
1 change: 1 addition & 0 deletions _speaker_sessions/aflynn_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ presenters:
- aflynn
- pcruz
permalink: '/events/opensearchcon/sessions/infra-opensearch-in-your-laptop-under-5-minutes.html'
youtube_video_id: 'zOc3L2sbMOw'
---

Setting up virtual machines and clusters can be complicated. To attract new contributors, OpenSearch testing needs to be simplified. Sometimes, local testing is preferred for accuracy in replicating production deployment. This talk covers ways to provision VMs or a cloud in under 5 minutes. It also explores the advantages of local deployment, testing, and evaluation of OpenSearch, emphasizing the insights into the needs of enterprise-grade deployment.
1 change: 1 addition & 0 deletions _speaker_sessions/agtunnell_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ session_time: "2023-09-28 - 2:00pm-2:40pm"
session_room: "Willow"
session_track: "Search"
permalink: '/events/opensearchcon/sessions/how-to-tame-your-llm-reliability-and-accuracy-in-ai-powered-query-generation-for-opensearch.html'
youtube_video_id: 'wqX9rYIV69I'
---

AI models for natural language can enable fundamentally new user experiences in OpenSearch. However, converting demos into production-ready features presents challenges in ensuring AI output reliability and accuracy. This talk will address these challenges in the context of building new AI-powered features for query generation and data exploration in OpenSearch. We'll examine some risks of language models, suggest mitigations, and share experiences from building a reliable query generator.
1 change: 1 addition & 0 deletions _speaker_sessions/ajambu_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ session_time: "2023-09-27 - 1:10pm-1:50pm"
session_room: "Redwood"
session_track: "Operating OpenSearch"
permalink: '/events/opensearchcon/sessions/how-to-create-restore-tier-and-search-snapshot-indices-stored-in-object-storage.html'
youtube_video_id: 'UuW32VTC_Jc'
---

This session will guide attendees on using object storage with OpenSearch for enhanced performance, increased capacity, and reduced costs. We'll demonstrate how to set up an object storage backend, register it as a repository, back up indices via snapshots, and selectively transfer old data to another node set, eventually tiering to object storage. We will also illustrate reading data directly from the object store in real time using searchable snapshot indices, bypassing data downloads to the cluster.
1 change: 1 addition & 0 deletions _speaker_sessions/astern_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ session_time: "2023-09-28 - 3:30pm-4:10pm"
session_room: "Willow"
session_track: "Operating OpenSearch"
permalink: '/events/opensearchcon/sessions/4-very-different-ways-to-migrate-your-data-from-one-cluster-to-another.html'
youtube_video_id: 'SWjCq0xTN7w'
---

Data migration, an often encountered task in managing OpenSearch in production, can be complex when managing data at scale. This talk discusses four diverse methods to migrate data between clusters: Cross Cluster Replication, Snapshot/Restore, Reindexing, and a method known as “The Node Toss”. We explore what happens “under the hood”, weigh the pros and cons of each approach, and suggest when each method should be employed.
1 change: 1 addition & 0 deletions _speaker_sessions/asundar_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ presenters:
- asundar
- lpavlov
permalink : '/events/opensearchcon/sessions/determining-the-user-flows-in-ux-search-relevance-engineer.html'
youtube_video_id: 'seINti01ECM'
---

This talk emphasizes the importance of curating user flows in OpenSearch UX, particularly for Search Relevance Engineers (or Producers). We'll present findings from deep-dive interviews with OpenSearch community's Search Producers. Our adopted user experience research and design process focuses on users' jobs to be done (JTBD) framework, placing the user at the center of innovation. Our approach allows us to discover users' pain points and hypothetical solutions in their job functions and data context. We'll also share proposed UX flows, demonstrating how we articulate success-paths for these users.
1 change: 1 addition & 0 deletions _speaker_sessions/bwall_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ session_time: "2023-09-28 - 10:00-10:40am"
session_room: "Willow"
session_track: "Operating OpenSearch"
permalink: '/events/opensearchcon/sessions/how-to-secure-ai-data-stored-in-an-opensearch-vector-database.html'
youtube_video_id: 'FC58Hxb1IKk'
---

In this session we'll discuss, common attacks against AI models, extraction of data, and the risks and rewards of leveraging ML embeddings using OpenSearch's vector database. Audience members will learn about use cases, technical approaches to the problem with searchable application-layer encryption for AI vector embeddings, and likely regulatory changes coming your way.
1 change: 1 addition & 0 deletions _speaker_sessions/dblock_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,6 @@ presenters:
- dblock
- dwiddis
permalink: '/events/opensearchcon/sessions/writing-opensearch-extensions-in-python.html'
youtube_video_id: 'TZy7ViZbbHc'
---
The Extensions SDK, a new experimental feature in OpenSearch 2.9, allows you to extend OpenSearch and independently scale workloads without impacting cluster availability. But did you know that this feature now allows you to write one of these Extensions in Python? No need to use Java, and there’s no JVM required, making it super easy to do. In this talk, you will learn how to write a plugin, how to write an extension in Java, and then how to write an extension on Python. We will also demystify some of the lowest levels of OpenSearch internals, such as its binary transport protocol.
1 change: 1 addition & 0 deletions _speaker_sessions/dfado_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ session_time: "2023-09-28 - 10:00-10:40am"
session_room": "Redwood"
session_track: "Search"
permalink: '/events/opensearchcon/sessions/information-discovery-across-multiple-models-and-indices-potential-for-search-pipelines.html'
youtube_video_id: 'KLuikg2cvys'
---

OpenSearch 2.8 introduces Search Pipelines as an experimental tool to streamline user search processes. The talk will discuss using Search Pipelines to align multiple indices with information models and business workflows, transforming it into a tool meeting specific business needs. For those dealing with legacy Elasticsearch and OpenSearch in complex information ecosystems, Search Pipelines can help consolidate outputs from distributed processing, allowing teams to better manage, monitor, and maintain information fusion.
1 change: 1 addition & 0 deletions _speaker_sessions/dtippett_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ session_room: "Redwood"
keynote_speaker: false
session_track: "Operating OpenSearch"
permalink: '/events/opensearchcon/sessions/going-deep-unraveling-the-secrets-to-opensearchs-ingestion.html'
youtube_video_id: 'xXEXnNIcvTg'
---

Ingestion in OpenSearch can be a bit of a mystery. Lets take a look behind the curtain and understand exactly how ingestion works in OpenSearch. We will go from client connection to the data being persisted on disk. By the end you will know how you can get more from OpenSearch using some of the new features like Segment Replication, ZSTD compression, and many more!
1 change: 1 addition & 0 deletions _speaker_sessions/dvenable_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ presenters:
- dvenable
- kkondaka
permalink: '/events/opensearchcon/sessions/now-is-the-time-to-start-using-data-prepper.html'
youtube_video_id: 'kxZR0pCQbbo'
---

Data Prepper is an open-source last-mile data collector. We will show you how how to get actionable data about your applications into OpenSearch. We will discuss how Amazon is using Data Prepper at scale for the new OpenSearch Ingestion product. And we will describe some of the powerful new capabilities Data Prepper offers for improved trace analytics and metrics generation. Whether you are using Data Prepper, another pipeline technology, or have no pipelines, you can benefit from this talk.
1 change: 1 addition & 0 deletions _speaker_sessions/gbafna_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ presenters:
- gbafna
- bkhan
permalink: '/events/opensearchcon/sessions/how-to-build-resilient-clusters-with-opensearch.html'
youtube_video_id: 'mRZ3-kbsc1U'
---

OpenSearch has become a popular open-source platform for log analytics, search, security analytics and observability. However, as with any technology, there are good and bad ways to use it. This talk will explore how OpenSearch clusters can commonly fail and how these best practices can improve the reliability and resiliency of the clusters. From common pitfalls, to building clusters that scale and continue to operate during failures, you will learn how to leverage some of the best practices such as client side timeouts & retries, health checks, configuring back-pressure mechanisms, handling zonal failures, tunings like GC, queues, troubleshooting failures and many more. This talk will provide practical advice for anyone looking to implement OpenSearch in their production environment.
Expand Down
1 change: 1 addition & 0 deletions _speaker_sessions/irakhmanberdiyev_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ presenters:
- smyssak
- amyssak
permalink: '/events/opensearchcon/sessions/how-we-jump-started-community-growth-in-opensearch.html'
youtube_video_id: 'LMKEJKJZOww'
---

This two-part talk first covers an OpenSearch SDM's journey to boost community growth in OpenSearch via a pilot, resulting in 500 participants, 300+ PRs, and 100+ issues in 12 weeks, and discusses organizational changes implemented. The second part features a key contributor sharing her experience participating in the program, forming professional relationships, learning from Amazon engineers, mentoring peers, and starting a business with newly made friends. A success story in all aspects.
1 change: 1 addition & 0 deletions _speaker_sessions/jhandler_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ session_room: 'Redwood'
presenters:
- jhandler
permalink: '/events/opensearchcon/sessions/end-to-end-relevance.html'
youtube_video_id: 'SavLxBGk20A'
---

Search engines give their users an almost-magical way to go from their goals to the information that meets those goals. When the items retrieved match the user's intent, then we say that they are relevant for that user and that query. "Relevance" spans much more than just the function used to rank the search results. Retrieving relevant results includes the presence of the data in the catalog, the way the data is analyzed, the methods used to augment and send the user's query, going beyond text to vector representation, feeding back user behavior, and of course, the ranking function. In this session, we'll take a broad look at how to use OpenSearch ensure that your users find the information that they need to get to where they are going, find the product they want to buy, or retrieve the data they need to solve a problem.
1 change: 1 addition & 0 deletions _speaker_sessions/jkressin_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ session_time: "2023-09-28 - 10:45-11:25am"
session_room: "Willow"
session_track: "Operating OpenSearch"
permalink: '/events/opensearchcon/sessions/harnessing-the-power-of-opensearch-performance-optimization-techniques-for-high-performing-clusters.html'
youtube_video_id: '3kcRrHBw0Rk'
---

OpenSearch performance, promising both improved responsiveness and operational efficiency. We will delve into the architecture and inner workings of OpenSearch, understanding how to leverage its design for optimized performance. With a blend of theoretical knowledge, real-world insights, and hands-on code demonstrations, this talk offers a comprehensive understanding of how to refine, scale, and supercharge your OpenSearch cluster for swift, reliable data access, propelling your data solutions to the next level.
1 change: 1 addition & 0 deletions _speaker_sessions/khamric_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ session_time: "2023-09-28 - 11:30am - 12:10pm"
session_room: "Redwood"
session_track: "Analytics, Observability, and Security"
permalink: '/events/opensearchcon/sessions/fast-track-integration-tests-with-distributed-traces.html'
youtube_video_id: '8wsa12XZcSs'
---

Monitoring and testing distributed systems can be complex and time-consuming due to their interconnected nature. Distributed tracing offers a comprehensive map to simplify system understanding. Trace-based testing further employs this data for deep integration tests. This session aims to expedite the monitoring and integration testing of your services in a near real-world environment, using OpenSearch's adaptation for the OpenTelemetry Astronomy Shop.
3 changes: 2 additions & 1 deletion _speaker_sessions/mshah_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ presenters:
- mshah
- jfritz
permalink: '/events/opensearchcon/sessions/generative-ai-and-search-whats-your-plan.html'
youtube_video_id: '8875QSsVj1c'
---

Rapid advancements in large language models (LLMs) are reshaping search applications with personal, empathetic experiences and improved search quality. This session will explore multiple uses of generative AI in search stacks, demonstrating how to integrate it with OpenSearch. From ingest to query, we'll illustrate how LLMs can enhance your applications without a complete platform shift, ensuring your search application isn't left behind in the AI revolution.
Rapid advancements in large language models (LLMs) are reshaping search applications with personal, empathetic experiences and improved search quality. This session will explore multiple uses of generative AI in search stacks, demonstrating how to integrate it with OpenSearch. From ingest to query, we'll illustrate how LLMs can enhance your applications without a complete platform shift, ensuring your search application isn't left behind in the AI revolution.
1 change: 1 addition & 0 deletions _speaker_sessions/nschwartz_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ presenters:
- nschwartz
- yvaknin
permalink: '/events/opensearchcon/sessions/building-a-powerful-hybrid-search-system-combining-text-and-vector-search-for-enhanced-opensearch-performance.html'
youtube_video_id: 'ydVfgITN8g4'
---

Discover the advantages of combining text search and vector search in a hybrid setup using OpenSearch. In this session, we explore how you can leverage both methods to enhance search accuracy and deliver comprehensive results. You'll walk away with practical techniques for setting up a hybrid search system using OpenSearch and insights on optimizing search results.
1 change: 1 addition & 0 deletions _speaker_sessions/parce_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ session_time: "2023-09-28 - 2:00pm-2:40pm"
session_room: "Redwood"
session_track: "Search"
permalink: '/events/opensearchcon/sessions/best-practices-for-managing-extremely-large-live-search-indices.html'
youtube_video_id: 'W0sOQmKzdcI'
---

Scaling search applications with large indices can be challenging, sparking debate over the efficacy of NoSQL databases versus document storage systems. This presentation compares different approaches to store vast numbers of documents, outlining each method's pros and cons. We demonstrate these solutions through a real-world case study of a significant search engine migration project from Elasticsearch to OpenSearch.
1 change: 1 addition & 0 deletions _speaker_sessions/pcruz_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ presenters:
- pcruz
- aflynn
permalink: '/events/opensearchcon/sessions/from-document-to-vector-using-opensearch-to-store-embedding-data.html'
youtube_video_id: '5p93QX7Ocrw'
---

The supporting infrastructure for large LLM jobs can be difficult and costly to set up. Storing vector data requires careful consideration of resource consumption. OpenSearch offers a straightforward way to store embeddings generated by tools like Azure OpenAI or the Natural Neural Search plugin. It also handles querying, reducing the operational overhead. This talk shows how to prepare pdf files, send them to Azure’s OpenAI API to generate embeddings, and store the resulting vectors in OpenSearch. This will be running on a low maintenance Raspberry Pi cluster and Charmed OpenSearch.
1 change: 1 addition & 0 deletions _speaker_sessions/pmprasad_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ session_time: "2023-09-28 - 11:30am - 12:10pm"
session_room: "Willow"
session_track: "Search"
permalink: '/events/opensearchcon/sessions/empower-your-keyword-search-with-text-expansion-technique-to-outperform-unexplainable-vector-search.html'
youtube_video_id: '_ipMfd7RuNk'
---

The recent vector trend poses the question: "Is a shift from keyword to vector essential for improving relevance?" This talk discusses using the text-expansion technique in Open to enhance Keyword by overcoming its limitations. We'll discuss how to expand documents and queries with contextual features using built-in ML models or LLMs, improving Keyword 's performance and explainability without the need for complete transformation to vector . Key message: Vector isn't the only route to increased relevance.
1 change: 1 addition & 0 deletions _speaker_sessions/rsaparkhan_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ presenters:
- rsaparkhan
- sturan
permalink: '/events/opensearchcon/sessions/getting-started-as-a-contributor-unleashing-your-potential-in-the-opensearch-community.html'
youtube_video_id: '9UU4eHO7GaQ'
---

Join this session to uncover the secrets of successfully starting your journey as a contributor to the OpenSearch project. Drawing from personal experience and sharing insightful anecdotes, the speaker will provide practical insights, best practices, and "cheat codes" to accelerate your engagement and make your contributions worthwhile. Learn how to overcome challenges and fast-track your involvement in the OpenSearch community while fostering meaningful connections and driving the growth and sustainability of the project.
1 change: 1 addition & 0 deletions _speaker_sessions/scrawford_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ session_time: "2023-09-27 - 10:40am - 11:20pm"
session_room: "Redwood"
session_track: "Community"
permalink: '/events/opensearchcon/sessions/running-opensearch-repositories-in-the-open.html'
youtube_video_id: 'xlzwgInCtfY'
---

This presentation will cover the process of converting the OpenSearch Security Repository to an open-access model. This change saw the Security Repository become the first repository to host open-to-the-public triaging meetings and has led to increased community engagement. Audience members can expect to learn more about OpenSearch's efforts to engage with the community, how to transition into similar models, and the benefits of this shift.
1 change: 1 addition & 0 deletions _speaker_sessions/sgaikawad_session.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ presenters:
- sgaikawad
- jzhu
permalink: '/events/opensearchcon/sessions/grokking-opensearchs-build-test-and-release-infrastructure.html'
youtube_video_id: 'VELWVLpbXmM'
---

This session explores the evolution of OpenSearch's build, test and release process, from manual scripts to a fully automated system with comprehensive logging and auditing. You will learn about the build system that enables community members to create OpenSearch and OpenSearch Dashboards. We will demonstrate its integration, flexibility, and efficiency. We will cover end to end process of distribution, standalone component releases via a 1-click mechanism, and the usage of a customized CI/CD system. This session will inspire you to think outside the box with your own release processes!
Loading

0 comments on commit 398327d

Please sign in to comment.