The keystone
Doug Turnbull,
CTO OpenSource Connections
#haystackconf
Who are we?
#haystackconf
We struggle with the toughest problems
#haystackconf
But what's important
to us?
#haystackconf
Skin in the game
#haystackconf
Such Core
Wow
Core
Secondary
Average Google Site Search Customer
We are here: Search/IR important to our business!
Nearly Secondary
… We have skin in the 'search game'...
"If it’s a core business function — do it yourself, no matter what." - Joel Spolsky
Corevalueness
#haystackconf
We're sorta stuck together
#haystackconf
FREEEEEEEEEDOM!!!!
We needs ta control oaaour destiny!!
#haystackconf
Average Google Site Search Customer
Us
… Most of us have skin in the 'search game'...
Freedom requirements
Customization: complete
Licensing: certain
Mindshare: static
Customization: some
Licensing: certain
�Mindshare: broad community
Customization: little/no
Licensing: who cares
Mindshare: doesn't matter
(aka 'bus factor')
#haystackconf
Hi my name is...
ONE VENDOR TO BUY THEM ALL
AND IN THE DARKNESS BIND THEM
UR search tools
#haystackconf
Hi my name is...
...Alexa vs early web...
#haystackconf
Hi my name is...
HOW DARE YOU QUESTION THE ALMIGHTY SEARCH ENGINE
PUNY MORTAL
#haystackconf
Empowerment
"Always be yourself, unless you can be batman. Then always be batman"
Actually having the tools to do our job
#haystackconf
Wasted $$ when we don't have good tools
Ideation
Industry
Plunger Invented
(1850-1900)
Plunger, a fancy plumbers tool
Out of box 'open source'
Out of box 'open source'
Table Stakes
Table Stakes
Secret Sauce
Secret Sauce
Wasted time: every plumber reinvents the wheel/plunger
Faster time to market, more opportunity to differentiate
#haystackconf
We need to commoditize repeat/busy work
Ideation
Industry
Commodity
Plunger Invented
(1850-1900)
Anyone can plunge their toilet
Plunging, a plumber's method
#haystackconf
LTR building blocks getting easier
Academia
Industry
Commodity
LambdaMART
(2010)
Solr LTR Plugin (2015)
ES LTR Plugin (2017)
Siloed LambdaMART wheels reinvented
#haystackconf
Two ways to solve these probs
VS
Product
Open Source
#haystackconf
Open source isn't giving us tools we need
Ideation
Industry
Plunger Invented
(1850-1900)
Plunger, a fancy plumbers tool
Out of box 'open source'
Out of box 'open source'
"Table Stakes" Grunt work you have to do
"Table Stakes" Grunt work you have to do
Secret Sauce
Secret Sauce
~2010?
Today
Stand up Solr, index data, throw a UI in front of it!
Significant gaps in what we need from open source
Let's see why...
#haystackconf
10
?
Is modern search?
OR
#haystackconf
ical?
Is modern search?
OR
#haystackconf
Analytics
Is modern relevance?
search
refine
click
Judgments
OR
Knobs & dials
Knobs & Dials https://commons.wikimedia.org/wiki/File:USS_Bowfin_-_Dials,_Valves_and_Knobs_(8326504403).jpg USS Bowfin - Dials, Valves and Knobs, Daniel Ramirez
LTR
#haystackconf
Whatcha get:
Search Analytics
Store
Enrich
Whatcha need:
App/Browser
Telemetry
Serving Search System
Learn
Content
Stage
Content
Features
#haystackconf
Modern serving search system reqs
Are Solr/ES up to the task?
#haystackconf
Lack of cohesive relevance community
#haystackconf
#haystackconf
#haystackconf
...Baby open source proj…
...we want it to grow up…
#haystackconf
...many threats…
#haystackconf
Building this rounded rolly thing!
If only someone would build 'Connections' in 'Open Source'
Building this rounded rolly thing!
Building this rounded rolly thing!
Building this rounded rolly thing!
Building this rounded rolly thing!
#haystackconf
Our mission: empowering relevance teams
Our BHAG: In 10 years, we want open source to be solution for the best relevance teams
YOU can do this, without vendors, including US!
#haystackconf
Our perspective: turn silos into plungers
Protect Sea Turtles
What wheels do we see reinvented?
Who can we partner with to fund/build open source?
How can we market/community build?
How can we add product vision for broader adoption?
#haystackconf
Partners Needed
TO BUILD OPEN SOURCE
#haystackconf
Most common gaps we see in OSS
#haystackconf
OSC co-sponsoring...
CFP due April 22!
TomTom ML Thursday
KEEP THIS COMMUNITY GOING!
See you in Berlin!!
#haystackconf