[Music] [Dan Burns] All right. Good morning, everyone. Welcome to our session, Accelerate Journey Time to Value, How MLB Delivers Game Day messaging to fans. My name is Dan Burns. This here is Ken Galuski. Some quick intros before we go ahead and get started. I'm a Senior Technical Consultant with Adobe Customer Solutions. Specifically, I'm in the professional services team in the Customer Journey management practice. I've been with Adobe for three years and in the marketing automation delivery space for 11.
Based in Rochester, New York, and a fun baseball related fact about Rochester, New York, its minor league team, the Rochester Red Wings, participated in the longest ever baseball game recorded, losing to the Pawtucket Red Sox in 1981 after 33 innings. [Ken Galuski] That is a very long game. Hopefully, this session is a little quicker than that. Good morning, everybody. Thanks for showing up for a fun early morning session. I'm Ken Galuski. I'm the Senior Manager of Email Marketing and Automations for Major League Baseball. I have 10 plus years' experience in email marketing with a strong focus on automation and customer lifecycle journeys. I am located in Chicago, Illinois, and this is going to be my fourth season with MLB. I don't have a fun fact, but I have a cool fact. I did get to live out a dream and caught a home run ball in the bleachers of Wrigley Field. And because it was hit by the other team, you bet I threw that sucker back as far as I could onto the field, which was a really fun bucket list item.
All right. So why do we all gather here at 8am this morning in Las Vegas? Two takeaways that we want you to get out of this session. One is to celebrate and share the adoption story of AJO with Major League Baseball. We want to walk through some of the touch points within the game day lifecycle where AJO is able to activate and deliver those messages to fans. We want to also highlight the partnership that Major League Baseball had with ACS to get to the adoption today.
And second, we also want to give you your own tips and tricks to accelerate your own use cases in AJO, from selecting the first use case to all the way through the development cycle and point out some features that can accelerate both customer value as well as business value. So I'll take a pause there. And, Ken, why don't you give us a rundown on all things Major League Baseball? Yeah. I'm sure most of us in the room are aware of Major League Baseball, but we are made up of 30 Major League Baseball clubs located all around United States and Canada. Season runs for 10 months of every year. Every team has 81 home games across 30 teams. That is over 2,000 baseball games that are played every single year. That is a lot of games, a lot of fans, a lot of engagements, all arriving at one winner for the World Series in the fall. And MLB continues to see really strong fan engagement in, just attendance. 2024 was our highest attended year in the last seven years with over 71 million fans attending the game.
We also continue to see really good success with our recent rule changes. Obviously, this got a lot of attention the last couple years. We worked to make the game shorter, remove a lot of the dead space within baseball games, and increase activity on the base paths, have received a lot of positive feedback from that. A lot more fans attending the games because of that. And then 2025 season, we're really excited to see where this goes. Just kicked off the other night with the Tokyo Series. Receiving a lot of positive feedback from that as well. It's been really fun to see the fan engagement and interaction over in Japan. I will not spoil. There was a game this morning. I'm sure everyone has not caught up on their phone in the news yet, but that series wrapped up this morning. So excited to get the actual opening day for all the other clubs started next week.
Do want to take a minute to talk about the kind of internal team structure at MLB because it is pretty unique. It's different than a lot of the other sports leagues and companies out there. In the year 2000, MLB and all 30 clubs reached a digital rights agreement that centralized all of digital marketing within MLB. That means we have a really close working relationship with all 30 clubs. To handle this, MLB has, what we call, digital producers, which are assigned one-to-one relationships with each club that allows them to work in day in and day out with each club, build up a working relationship with each club, and work as a great liaison between the club and the rest of MLB.
We, my team, the email tech and ops team, work very closely with these digital producers. We are the Journey leaders. We run everything Journey, we build Journey, we educate everything on Journey. So we work really closely with these digital producers to intake club requests, build out new processes, educate people on how to build, and just learn everything Journey related. We also then work very closely with other internal MLB teams, our data teams, our tech teams, our mobile app teams to coordinate club requests, gather information and what we can and can't do, and then roll those out through educational sessions to digital producers and clubs.
This also means we have a lot of data flowing in constantly across all the clubs. That opens a lot of really cool fun doors that we are continuing to leverage when we can to build up really fun fan experiences that we're going to go through a bit today.
Dan, why don't you tell us a little bit about some of the Adobe adoption-- Sure. That we've gotten to? So before diving deep into Adobe Journey Optimizer...
AJO was one facet of the overarching foundation that Adobe Experience Platform is playing today in the day-to-day operations for Major League Baseball.
If you were here in 2023, you may have attended a session by Kasia Danilczuk, Fan Data Director, as well as Crystal's ACS Enterprise Architect, where they highlighted what AEP was going to do for their team in terms of segmentation and democratizing segmentation, reducing the hours that it took to build and activate audiences as well as the number of resources that it took to productionalize those audiences. And needless to say, that still remains a pillar of the overall adoption with AEP.
The club's marketers are able to go and build those robust audiences.
They are able to focus on building those and still allowing consent enforcement to ensure the fan's privacy and preferences are maintained...
And so they're building those at scale. And further, they're able to also use some of the destinations within Real-Time CDP, both owned and paid to activate. And some are even using CRM destinations like Salesforce and Dynamics 365 to enrich some of those leads in those sales CRM systems just to further engage with those leads as they're becoming potential season ticket holders.
MLB is also using other tools like Adobe Media Mix Modeler to optimize marketing channels spend holistically across channels, gathering those insights and providing them to clubs.
Other use cases are within Customer Journey Analytics. So clubs are using ticketing sales dashboards that are within CJA and also identifying how marketing tactics are performing using dashboards within CJA as well. So all this to say is when you look across spectrum of all the capabilities that MLB is using, it's even more impressive when you think about the fact that it's also being done for all 30 clubs in a standardized and scaled way.
So, Ken, why don't I hand it to you to highlight how you're using AJO for your team and ultimately for the fans' needs today? Yeah. So what we're going to walk through today is how we're using AJO to fulfill our customer acquisition lifecycle, more specifically, our ticket acquisition lifecycle. We've been able to utilize AJO to either come up with new programs or expand upon existing programs to really hit every single step of this fan lifecycle, that is, acquiring a ticket purchase. After a ticket purchase, what do they need to know before they go to the game? Then what do they need to know when they're at the game? What do we need to tell them after the game? And then how do we get them to come back to another game? So we have some great use cases. We're going to go through each of those here, in a minute as well. But we've seen some really good evolution using AJO to help expand these programs in this lifecycle.
So we've seen a lot of good success with AJO last season, and we knew to scale this out. We've already talked about how we work with all 30 clubs. So everything we do, we have to do 30 times. That is a lot. We knew if we were going to actually efficiently scale this out, we were going to have to come up with a templated approach that we'd be able to carry across all the clubs. So 2024, we worked to generate 10 use case templates that all clubs would have access to opt into and utilize. We also knew that we were going to need help in building these out, email tech and ops team being the leader and the dictators of these journeys. There's only seven of us on the team. There's 30 clubs. That's a lot of requests flying in. We knew we were going to need help from those digital producers, so we worked to train up and educate them. By the end of last season, we had 15 people educated on creating journeys, and that is largely 15 people that have never created journeys before. So some good success there. By the end of the year, we had all 30 clubs running at least one journey, if not multiple, and extrapolated out, we had over 180 journeys created and launched last year, which is a lot. And thanks to scalability, we were able to do that, and with the help of digital producers...
We wouldn't have been able to do that without being able to scale this out. For those that don't have AJO, AJO has a great capability to package up a journey, and then you can share that journey out to multiple sandboxes. So each of our clubs has a sandbox within AJO that is very beneficial because we can build it in one place and then copy and paste that to all 30 of our clubs, and we're not building from scratch in every single club sandbox, which was hugely beneficial in scaling this out.
So how do we get there? How do we get to 180 plus journeys with everything Ken just mentioned? So in the last 18 months, what AJO looked like in terms of use drastically has changed. So late in the 2023 season, there were a handful of journeys that were run by the ACS team on behalf of Major League Baseball. And over those 18 months, we've come to a point where Ken and team manage a full intake process to facilitate and activate on behalf of the clubs and branch where those requests need to go. So the flexibility there is that when new valuable use cases are proposed by the clubs that maybe we weren't necessarily thinking of and they weren't necessarily in the use case library that was mentioned, then those can be facilitated and passed to the ACS team to help develop and then work with the fan data product team for any sort of technical integrations that need to take place to bring that use case to life.
So initially getting the use case and the capabilities was critical back in 2023, but in order to scale this, we had to work with a lot of teams to ultimately provide those use case templates that were available for all 30 clubs. So some of those activities are outlined here in this slide, but we'll also dive into a few of those here just now.
So we'll dive a little bit deeper into 2023 and the initial capability and the capability focusing on using ticket scans at the ballpark and streaming them into Adobe Experience Platform for one-to-one journey orchestration and ultimately messaging after that check-in.
So if you attended 2024 Summit, you may have heard on the Keynote session by Chris Marinak that the Ballpark app is the means to have a direct conversation with their fan. It's the flagship app to do so. And as fans are checking in or scanning into the ballgame, they're doing it on the Ballpark app. And so this information is able to be streamed from MLB's ticketing platform into AEP and ultimately, into journeys. And Journey Optimizer was that place to facilitate and orchestrate that direct conversation with the fan.
So there's jam packed information that's on that ticket scan that we can make use of to orchestrate a journey. So as information about the fan, so not necessarily who purchased that ticket, but it's associated to them as a fan and associated with their device. We know who is checking in and scanning into that game. We also have information about the device, so we can ultimately also send push notifications afterwards. And then we also have information about the context of the game and where that fan is sitting. So we have all this information that we can make use of to start a journey in AJO. So we apply and allow Adobe Journey Optimizer to do its magic in terms of conditioning and determining whether to send or not send a message, to wait all within the journey in real-time. So we can do things like checking, is this fan a season ticket member? Is this their second time attending a game this season? We can also leverage some of that event context on the ticket scan itself. Do we want to send them a message if they're sitting in a particular section? And then ACS also worked with a Ballpark app team in 2023 to find a means to activate through a custom action in Adobe Journey Optimizer to actually send that push notification to the fans. So we packaged this all together, and we had a really neat way to go to clubs to start to activate, and use this to address a net new opportunity, a new stage in the customer lifecycle that hadn't previously been addressable.
So in 2023, we ran those handful of journeys. We were running journeys for clubs to send to those that are sitting in premium clubs. There was merchandise associated to those clubs and send them messaging to promote the merchandise. We also sent messaging around seat upgrades using that seat section value to ultimately get you to potentially upgrade your seats for that game.
We are finding very quick wins after running those journeys, specifically around engagement. Now these journeys saw significant uplift in the push notification engagement compared to a baseline of how MLB was originally doing campaigns for push. So that was a huge win. These wins culminated in the World Series and the post season with running journeys on behalf of the Texas Rangers. The Texas Rangers wanted to promote the use of their mobile ordering app feature within the Ballpark app for the post season, and we started in early on in the series, and one of the series running this and very quickly saw success and incremental lift in that mobile app feature, in the mobile ordering app feature. So it was valuable for the fan, and obviously, the Rangers wanted to proceed with leveraging that all the way into the World Series and they eventually became the winner of the World Series.
So also in parallel, we were ramping up additional capabilities. Like, we were seeing these quick wins, but we wanted to continue ramping up the capabilities. So internally, all of us, while we were watching the games, we were running these world series of business event triggers. So being able to automate, after the fourth inning started, being able to trigger real-time messages to ourselves internally to validate this capability was working before rolling it out to clubs.
So we had a lot of wins in 2023 that rolled into preparing for the 2024 season. Yeah. Those wins were awesome to see in 2023. And as soon as we saw that, we're like, "We have something here." We need to figure out what to do with this now. Baseball is nice. We do have an off season that allows us a little bit of breathing room, but anyone at baseball will tell you that there is no off season. It just continuously goes, and it is busy all year round. But we took this off season to take a step back, realize, "Okay, this worked. How do we move this on? How do we expand upon this?" We considered a couple of things here. We took the user requirements from the MLB side. So what data did we have available to us? Who did we want to be the leaders of this? Ultimately arriving on the email tech, and ops team that I'm a part of, as we are then able to facilitate who is designing these journeys, who's going to build them, and stuff like that, as well as club requirements. Clubs now know we have this tool. What are they looking for us to utilize this tool to do as well? Obviously, that is 30 clubs, 30 opinions, 30 thoughts, 30 wishlists. We needed to consolidate all of that into some journey MVPs or minimal viable products of what can we roll out at a base level for every single club to start with before we start re-evolving and reinventing the wheel for every single club. We consolidated this into our 10 use cases in 2024, which we evolved into journeys, and journeys led to documentation. And that is where we got to in 2024 with those 180 plus journeys. We could not have done that without paralleling training up the digital producers like I talked about earlier. These are folks that are already working in 5, 10 other different tools, helping out the clubs on a day-to-day basis. We were now throwing them another tool and saying, "Now you need to learn journeys, and you need to learn how to utilize that." It was not an easy task. These are people that have never built a journey, never activated a journey before. We had three months to do that in as well. So over the course of January to end of March, beginning of April, which is the opening day for Major League Baseball, we held four enablement training sessions for our digital producers that were required and mandatory for them to attend. These consisted of hands on step by step instructions walking them through how to build a journey, start to finish, cultivating in a push notification that showed up on their own phone, showing them that what they built actually did work, so they got to actually experience it as well. As well as we also held weekly reoccurring office hours in which, Dan, ACS team, MLB team all were available as an open forum for these digital producers to come to us with questions, thoughts, concerns about what they were seeing to really continue to educate them as fast and quickly as we can. Saw a really strong success in doing this and the hands-on approach was very beneficial. Like I said, that led to almost 200 journeys last year and largely thanks to their capabilities of scaling that out.
So quickly before we jump into the use cases, we did just want to call out just really quickly of how Adobe continues to be a standout name in MLB.
Like Dan mentioned, some of the clubs are now designing and developing outside of journeys their own audience segmentation. They're using Real-Time CDP to go in and draw up audience segments. This was a huge win for us because up until this point, it was either audience requests that came to our team that required very heavy manual SQL loads within our data to pull these lists for the clubs or working in data teams or club ticketing teams to pull these audience lists. This now gives us the access and the club's access to go directly within Real-Time CDP and design these audiences themselves and then let us know when those audiences were created, which was awesome.
AJO has also hugely helped the expansion of a lot of our programs. You'll see in these case studies here in a minute. Obviously, before AJO, we have external tools that we're using and launching programs with that had been existing for years. Those programs have reached their limit within those tools. We've extended as far as we can within them. AJO really helped loosen those handcuffs and open up the program and allow us to expand those into some new cool functions and features that we're going to show in these use cases, that would have been very beneficial for us so far.
We also created a use case library in close conjunction with Dan and our ACS team. Working with all 30 clubs, two of the most common questions we get are, what are other clubs doing that I'm not doing? And what aren't I doing that I should be doing? We answer that question so often that we said, "Dan, we need a solution for this. We need a place that every club can go and see a visual, basically living library of all of our use cases." They developed a microsite of sort, that all the clubs have access to. They can go to it. They can visually see what each use case looks like. They can opt into it in very high level metrics of the clubs that have been running those programs, what are they seeing to help share that out with the clubs as well. Seeing really strong feedback from that as well.
The input requests. So I mentioned that our email tech and ops team is the facilitators of all requests from clubs. Up until creating an official process form, it was the wild wild west. We had 30 clubs emailing our inboxes. Everyone's trying to flag who's handling what, and we're trying to keep everything organized. It was pretty chaotic, and we knew we had to solve that. So we created a very formal intake process in which the clubs would have a form that they could fill out. The form would get submitted to our project management tool. We would be notified that a new submission was created. That allowed one team to be the centralized shareholder of how is that going to be submitted or how is that going to be handled. So it could be everything from, "Yep, I want to use one of those use cases. Just turn it on." I can pass that then to our digital producers and say, "This is pretty easy. Take this use case, and you should be able to build it out from there." To the complete opposite end of club coming to us saying, "I have this crazy new idea," us saying, "That is a great idea. Let's figure out how we can make that happen," in which we can then pull in Dan and our ACS team to be like, "Hey, this club came to us with a really fun idea. We think there's a benefit here that not only for this club, but potential to be used across all the clubs and working with them to build up these new use cases." The project management tool also allows organization of all these requests. We can see them in one spot. We can then see due dates and who's working on what and where certain projects sit. So that has been very beneficial for us as well, and my inbox thanked us tremendously. And then lastly, evolving Real-Time CDP into a one stop shop for journey optimization, journey activation and performance measurement. The call out here is CJA, and this is a work in progress here down at the bottom. But up into this point, clubs are also very much on their own to do reporting, and we get hit with those requests a lot as well as how is this journey performing for me, or what are we seeing from this program? We have worked very closely, again, with Dan and our ACS team to define some CJA dashboards, that are, again, a one-stop shop for all clubs to go and see the exact same thing. So when they're doing it on their own, that's 30 clubs doing reporting 30 different ways, looking at 30 different things. This gives us all a centralized place to go to look at the same metrics, the same type of reporting on program performance, and it's going to be hugely beneficial for us as well.
All right. Use cases today. I know that's what a lot of us here want to see, so let's just go ahead and jump right into this. We're going to start at the very beginning of our lifecycle for our ticket acquisition...
With a program we call our Displaced Fans. Now when you probably think of ticket acquisition, you probably think of a club reaching out and asking you to buy tickets. Yes. That is the broad sense and the largest use of acquisition step. What we wanted to showcase today was a more niche approach within our acquisition that is a league wide program called our Displaced Fans program that AJO has allowed us to open up and expand upon. So let's use the use case scenario. Dan is a San Diego Padres fan. Dan lives in San Diego. Pretty easy for the Padres to say, "Cool. I'm going to send Dan an email and say, "Hey, Dan, come to a Petco Park this week where we have a home game." Inversely, Dan's a Padres fan, and Dan lives in Atlanta. Not going to be successful if we send Dan an email that says, "Hey, Dan, Padres are at Petco Park in San Diego this week. Come on out." Dan's not driving across the country, flying across the country to go to that game, unless he's a true diehard fan. But this program is designed exactly for that. And I do need to say that this program was preexisting to AJO. But prior to AJO, it was a automated daily triggered email that went out once a day, and it was generated via very heavy SQL audience, 100, 200 rows of SQL that make any adjustments to that. You don't want to mess anything up. Not very flexible in terms of making edits. Working with Dan and their AJO team, we were able to transition this program to AJO and trigger it off of a custom business event. This custom business event, which Dan is going to get into the technicalities of in a minute because that is all stuff that was well over my head as well, but the custom business event was able to tap into our stats API. We have a stats API that contains a lot of very powerful and useful information. Part of that information is away series information. We can use that information and then say, this club is starting in away series in this town, and we know those fans in that town. Let's reach out to them via this journey. That allowed for a lot more flexibility within the program. Moving to AJO also allowed us to expand the program in terms of multichannel. So this was just a daily triggered email that went out 14 days before the team was coming to your town. Moving this to AJO, we've expanded it into two emails and a push notification. So we're now doing 14 days and 7 days as a, "Hey, heads up, your team's coming. Reminder, your team's coming next week." And then the push notification is a great Hail Mary a day or two before the game that says, "Don't have plans this weekend? Come on out. Your Padres are in town in Atlanta. Don't forget to purchase the ticket." So we've seen some really good growth success from this program and evolving it into AJO. Now, Dan, let's get into the technicalities. - Tell us about that business event. - Yeah. So a fun thing and what's really unique about this journey and specifically, you'll see a handful of game event journeys later on, is using the business event in AJO, which I feel like is a nugget of feature that is underutilized and really powerful. So think of like a back in stock business event, something that's happening about your business, that order, that SKU is now replenished. You may have a subset of customers that are interested. Maybe they save that item for later when it's back in stock and they save it to their online profile. That's a great example or a great use case for leveraging a business event, but also then making it really truly customized and associating it with a group of customers who are interested in that business event. And so what we did, we worked with the data engineering team in ACS to build and compile a away series record or event, if you will, so we pull that stats API, 14 days out, we do this for all 30 clubs. It's pretty straightforward, even from a technical aspect, but then it streams that business event in, and we're able to associate that with all of the Padres' displaced fans. We bring all those displaced fans into the journey, but very quickly, and you see maybe in that that third node within the journey, we're able to isolate those that are displaced fans that live in Atlanta. And we're able to do that by identifying the away team or the excuse me, the home team on the event, and then just say, "Okay, well, these are the Padres displaced fans that we want to target in this journey." So a really nice use case for the business event.
All right. This next use case is the next step in our lifecycle. So a fan has purchased a ticket, but they have not gone to the game yet. What do they need to know before they attend the game? This is potentially the most important step within our customer lifecycle is this is delivering highly important information for the fan. Know Before You Go program is pretty standard in the industry, but it's exactly that. It's telling them what they need to know before they go to their event. And this includes everything from the pitching matchups, to gate times, to parking updates, just very important information a fan needs to know. It's also great to call out that this is not a sales email. Not everything within your lifecycle needs to be promoting sales. It's not all buy, buy, buy. This is fan experience. This is fan engagement and getting them to really have a better time with the overarching experience of going to a game.
The wins here by moving this to AJO, again, this was a preexisting program, very similar to Displaced Fan. We were launching it on a daily triggered email that would go out every day before, we look at our ticket holders who had a ticket to a game tomorrow. We'd send them an email. That was it. It was pretty hard coded. We heard and we listened to the clubs that a lot of clubs say, "That's great, but I get a lot of my ticket sales on the day of the game. And those people aren't getting this email because it already went out the day before." We're like, "Okay. That's a big problem. We need to solve this." We worked with Dan and our ACS team to create this time, a custom unitary event that is attached to our ticket holder data. The benefit of this is we can ping that custom event every hour and scoop up new purchases that we were missing out on before. So because that other one was hard-coded SQL and hard-coded template, daily triggered message, there wasn't much flexibility to bring in those new users. This program allows us to do that. So we still send out that email 24 hours before a game. Everyone that has a ticket, awesome. They get to know it. But now every hour leading up to that game, we can scoop up new purchasers or ticket forwards, which we also get a lot of on the day of game. "Hey, I bought a ticket. I'm forwarding it to you on the day of the game." Before we weren't able to accommodate for those, that person now registers as a ticket holder and is going to be scooped up by this journey and pulled in and say, "Hey, we know you have a ticket to today's game. Here's what you need to know before you go." That was a huge win. Some clubs said up to 60% of their audience was buying day of game or within 24 hours of the game. So we fill that huge gap of missing out on 60% of those people.
Other win here, just like Displaced Fan we were able to evolve this into multichannel as well. So a push notification Know Before You Go prior was not unheard of, but it was done very manually. So club would say, "Hey, our parking lot's actually closed, or this part of it is closed today." We need to send everyone a push notification. That required them pulling a list of all going to their ticketing or data teams to pull a list of all those people, saying it to the digital producers. Digital producers would have to go to our tool, send that all up manually, and potentially have to do that for every game within a homestand, very manual approach. This allows us to bake that communication into the journey. Obviously, try to keep that as evergreen as possible. So the goal is here not to change that messaging for every game or every series, but allows us to automate that process with the email. So an email and then a push could go out the day. "Hey, you're going to today's game. Don't forget that Parking Lot D is under construction," or "gates are opening at 03:10 for tonight's game." Stuff like that was all great information we could then send to them via the push notification to the Ballpark app.
Okay. So far, we've seen promoting that ticket acquisition, educating fans as they procure that ticket and are preparing to go to the game. Now it's time for the fan to arrive and ultimately check-in and scan their ticket through the Ballpark app into the venue. So this is where the check-in use case comes into play, and this is all derived, this template, from those early capabilities that we were exploring that I was mentioning earlier. So this is a very streamlined use case, a very popular use case. Again, this was the capability that didn't previously exist to be able to speak to fans in this new way and new means in a very important part of the fan lifecycle, and so this has been very popular. And we've seen it used a number of ways. We've seen it, like I mentioned earlier, for seat upgrades. As they check-in, for a given, let's say, homestand or maybe even a longer period of time, if there's inventory available, clubs will identify the sections that are eligible for this promotion upgrade, and then that fan may see their ticket, they may have a sense of where their seats are, they get that push notification, they see the value in doing that upgrade, and then they get a better fan experience during that game. We've also seen it, or are seeing it used for two clubs that are going to be playing in new ballparks this season, and one of those clubs we know will be leveraging this check-in journey to educate their fans around that ballpark as they enter it. We've also seen it to welcome back season ticket holders.
Maybe they're returning for the first game of the season. Like I said earlier, the journey can pick up some of those attributes around the fan and make use of them to personalize that communication after checking-in. We've also seen patterns where instead of leveraging the seat upgrade and actually promoting the actual upgrade, but rather is a surprise in delight for venues that are maybe north in the Northern States, during April, it's cold, it's wintery, some of those higher level sections. If they see someone checking into those higher level sections, they can send a note that says, "Hey, surprise and delight, we're going to bring you down to a lower section, get you out of the wind before the game starts," so a really nice example we've seen this used as well.
Not just the clubs are using it, the league is using it, and use it in the-- Or at the end of 2024 season as Go-Ahead Entry, and using facial recognition through the Ballpark app even more seamless way to get into the ballpark. The league was using the Ballpark app specifically, was wanting to use this journey to segment 5% of those that were using the Go-Ahead Entry and then get their basically survey them and poll them about their experience of using that new capability. So a number of great ways that the clubs have been using this check-in use case.
So the next two use cases do a great job of bridging that physical experience and delivering a digital one through the Ballpark app in a very contextual, personalized way, and this one specifically is called the game event inning change use case.
So the way this works is very similar to what I was mentioning earlier with the business events and leveraging the stats API information. What this does is over the course of the game, that similar process that was developed by our data engineering team is able to connect to the stats API and use a WebSocket to exchange information about the game and those live in game events into that process that our data engineering team built, and they can parse out the events, whether it's events about the state of the game, like inning change, start of game, game over, or things that are actually events, like strikeout, stolen base, home runs, and parse those out and bring them into platform as business events, and we can make and allow clubs to make decisions whether they want to activate on some of those events. So really another cool use case of business events. And the way this works is identifying who the right audience is to actually associate with that business event is pretty straightforward. We make leverage of streaming audiences and are looking for, at that ballpark, those check-ins and those ticket scans that took place in the last few hours, and we associate that, those that are attending the game with the business event, and then we can filter, condition, whatever we want to do to ultimately deliver a push message to the fan while they're at the game. So a really meaningful way, a good highlight of using this is the Tampa Bay Rays.
They send a push notification in the fourth inning, based on that fourth inning event, what happens in the fifth inning or end of the fifth inning is a mascot race. It happens every single game that the Rays host, and so there's a vote. You can vote within the Ballpark app for who's going to win that race, and if you win, you're eligible for some prize every single game.
And so what they found after running this push notification, delivering it in a very timely way to the fan right on their device, it's just right there when it comes time for that race to start. That push notification is a deep link to the survey, and they saw a significant uptick in the engagement of that program. So they continue to use that over the course of last season. Another example is for last call messaging. So being able to use the sixth inning, where maybe your concessions are closing inning and a half, maybe middle of the seventh, and being able to send a promotion or a last call to action, all the concessions are closing. So again, highly timely, making sure no one misses out on that last beverage or last concession run.
So finally, game over. Game over layers on top of some of those business events that I was just mentioning. This one is specific to the game inning-- To the game ending, excuse me, and making sure that the home team has won.
And so what that's able to do is we can bring in that same audience, those that have attended the game, and we can start to message those fans and leverage the positive experience that they just had. Specifically, in this use case template, we're looking to send a communication, start the conversation to bring single game buyers. Those that may not have plans to return to another game, start that conversation to bring them back in that heat of the moment, they just have this great experience, let's try to start the conversation. And this template is flexible enough because we've seen a lot of clubs have different hypotheses around what is the right timing to send this and start that conversation, or what channel should we activate this sort of communication in. And so this use case is flexible enough to do all that. But what we've also seen this game over messaging used for is also section-based messaging. So some ballparks have activities or venues within that that are still open after the ballpark or after the game ends. So leveraging that to promote partaking in festivities that are happening at those venues or those restaurants.
Yeah. And before I jump into this one too, I want to state the three in game triggers Dan just talked about. Those are brand new. That was a gap in our lifecycle, our communication lifecycle before. We were doing it, but it was very manual. And a lot of that was, "Hey, we had 10 strikeouts," and then the club would have to flag down a digital producer while they were sitting at home at 8 o'clock at night saying, "The team just struck out 10 people. We need to send this email out to everyone," and then the digital producer would have to log on and do that. We're working with Dan and ACS to automate all that as well. So like Dan mentioned, home run, stolen bases, all that stuff is on our roadmap for 2025 to continue to develop into. But now we have this great capability to message fans while they're at the game. I do want to also call out those three examples are just available for clubs. They're not standard within the lifecycle. We're not forcing clubs to do that. They have the option to opt into all of those. And with that option, we also make sure we notify them that be cautious of how often you're communicating with fans. It is great to have these tools, but we don't want to be overcommunicating, especially when it comes to push notifications. It is very easy to annoy somebody to turn off push notifications, and it is very hard to get them to turn notifications back on. So be very cautious with that. And we often tell them to prioritize which ones are more important to them or use cases and to make sure that the fan experience is not being bombarded because we can and more stepping back and saying, should we? So quick shout-out for that before we move into this last step here, which is our win-back approach. This is our Single Game Buyer Retention program. This one has been really fun and exciting, because it has been seeing it go from crawl, walk, run. It started a couple years ago with proof of concept of, "Hey, can we message everyone that went to a game, and just send them an email and say, 'Thanks for coming. Buy another ticket.'" I don't even think we had personalization in that very first iteration of it. It was just throw the net out and see if we can get people to come back. The proof of concept did work, and we did see good win back rates from the program. And we knew we had something again, and we wanted to continue to expand and extrapolate it out. It went from one email to three emails. We moved it into a journey. We talked about hitting different touch points within each of those three journeys, so it wasn't just buy, buy, buy. It was, "Hey, come back. Maybe check out this new part of the ballpark you didn't see before." Again, so really strong success from that in 2023. 2024, this program blew up in an awesome way using AJO.
We were able to incorporate multiple channels, multiple touch points. It went from three emails to three emails, two push notifications, and a Facebook ad at the end of it, all automated. Facebook ad being at the end, let's see if they're relatively cheap free channels at the beginning. Email, push can do some heavy lifting before we start throwing money at them via the Facebook ads. You can go on. You can show the example of this next one. This is an example from what the Toronto Blue Jays ran in 2024. I really like this example. It's really engaging. It stands out. It pops in my inbox. Each of those touch points talks about a different content point. And I do need to call out, this was their creative from 2024. They just launched a brand new brand for 2025. It's really cool. Go check it out when you get a chance. But I really like this one, and we've seen really good success from expanding to multiple channels. That was our very first journey, which we extrapolated this out into such a large multichannel journey. And we did see that doing so, fans that received that got an email plus a push notification converted at a 40% higher rate than fans that got just an email. That was awesome to see. That proved that there was something here. We needed to continue to think about how we can utilize this approach across other programs, as well as, it was working as a reminder tactic. It was the combination of channels was doing exactly what we hoped it would do and fans were engaging with all of it, which was awesome to see.
The other huge win in 2024 was tailoring the content to customize for each individual fan.
I'm very excited about this. This is where the future of this program is heading as well. But we took a step back, and thinking about that first email, which was just, "Thanks for coming to the game." We didn't even put a name in there. We hope you came back. We learned that if we really want to win these fans back, we need to tailor the content based off of each fan's experience. Every fan has a different experience. Even within the same game, you could be sitting in the bleachers or the grandstands or wherever. You're going to have a different experience. And we have the data and flags within our data that allow us to give these different experiences to our fans. So 2024, we tested four audience segmentations, the first of which was first time attendees. If we know it was your first time ever coming to that ballpark, we can talk to you differently now. We have a flag in our database that says, "Hey, Dan, checked in today." This is his first time ever checking-in. Maybe we need to talk to that fan a little bit differently than just a diehard fan. We've found that it's really hard to win these fans back. A lot of them are just-- They're not diehard baseball fans. They could be tourists. This gives us the capability to communicate with them differently than we would those diehard baseball fans. The other big win within their segments was exactly that. It was win loss. So if we know a fan went to a win, awesome. We can give them a content that says, "You're a lucky charm. Come back for another game." If we know they went to a game where they lost, we've also learned it's very hard to win back a fan that went to a loss. They didn't have the same experience that a fan went with a win. That win comes with a high. You're with a crowd. You really loved your experience. Loss is the inverse. It's like, "All right. I had fun. It's okay. The crowd wasn't in it totally. Everyone just moped as they walked back to their car at the end of the game." What this allows us to do is then say, "Hey, we owe you one. Come back. We owe you a win." It's also a great way for us to not cast offer nets across all of our audiences. So we've recommended to clubs that say like, "Hey, maybe for this lost audience, we can throw an offer at them." It might take a little bit more for that audience to come back. And a lot of the clubs say like, "We don't love offers. We don't love giving away free money." I get it. Totally. This is a great way to not give that offer out to 100% of everyone that attended a game but just to the small portion of the fans that attended a lost game because we know it's going to take a little bit more to win them back.
The third audience segment we tested with was promotions. Promotions are huge. Everyone loves promotions. Promotional release calendars are up there with our highest engaging content out there. But we have flags within our database that tell us if the game was a promotional giveaway game, if there was a bobblehead. Bobblehead fanatics are real. It's a thing. Everyone loves bobbleheads. It performs gangbusters every time we talk about them. And firework nights. So if there's a firework after the game, maybe the crowd was a family. Maybe they wanted to go to the game just because of the firework night and bring the whole family out. We now have flags that we can differentiate that audience and deliver them different content. "Thanks for coming to Shohei Ohtani bobblehead night. Here are our next upcoming bobblehead nights," because that may have been the only reason they went to the game, so we could potentially utilize that to get them to come back to another one.
The last segment that we tested and saw good success with was seating section. A lot of our stadiums and ballparks have very unique seating sections that the clubs love to lean into. Our friends at the Cubs, utilize this for their bleachers for the iconic Wrigley Field bleachers. If we know a fan sat in the bleachers, let's call that out. We were able to design an email with them that said, "Thanks for sitting in the Budweiser bleachers. Come back to another game at Wrigley Field." We can show an image of the bleachers, really tailor that content to the exact experience the fan had, and leverage that to try to get them to come back to another game.
That is all that was beta tested in 2024. With each of those segments, we saw really strong success. 2025, we've opened the floodgates and allowed all the clubs to pick and choose, which ones they want to opt into, because there's a lot of beneficial there. So I'm really excited to see where this program continues to go and the results we see from this in the upcoming season.
All right. So those were our use cases. Want to finish the use case section here really quickly and just talk about how we're activating with AJO today. We talked about that use case library of all of our AJO capability options that clubs can opt into, seeing really good positive feedback and success with that. We do continue to hold weekly office hours for the clubs and digital producers on all things Adobe and AJO. Been receiving a lot of feedback as clubs continue to adopt that more and more. Again, new tool for everyone, so it's a great open forum for a club to dial in and say, "Hey, I was building an audience the other day. I saw this weird thing. Can you help me walk you through it?" Great educational tool, not just for them, but for anyone else who dialed in for help that day can learn from what the other clubs are doing as well. We also have a handful of clubs that AJO is not just business as usual. Early adopters to this allowed us to build up a lot of their programming, and they'd use AJO day in and day out. A couple of use cases we didn't even talk about today, but loyalty program communications, we've started to adopt those and build those into AJO. CRM integrations and the Know Before You Go program are some of the bigger wins we've seen within AJO this last season. Lastly, we worked to define that intake process. Very hard to organize 30 requests and 30 clubs, and this process has been hugely beneficial in organization, control of who's going to be handling what, how it's going to be handled. We've seen a lot of positive feedback from this as well.
All right, Dan. Tell us a little bit about how we can accelerate and get some tips and tricks for these use cases. Sure. Yeah. And before I really dive deep in here...
I think what's important to call out is, obviously, the adoption and the scale that we saw today wasn't magical. It didn't happen overnight. Over the last 18 months, just recapping that it was a great collaboration between multiple teams to get us where we are today, but it was also propelled by that initial use case. I think when we think about use case selection and how you can expedite your time to value with AJO, what MLB did right, it was identifying the right use case for AJO, where it really addressed a need and a new opportunity to engage with the fan in the very pivotal part of their customer lifecycle that they previously couldn't do. And I think when you think about use case selection as your first use case in Adobe Journey Optimizer, and maybe you are starting your path with leveraging AJO, is finding something similar. What can't you do in your marketing stack today that requires that one-to-one orchestration, because that's what AJO does best. And so fitting that right use case and matching it with the opportunity that you have to engage with your customer is pivotal, and if you see the cross between those...
That is what you want to identify as a first use case within AJO.
We've seen from an ACS perspective, a lot of projects that do start with things that are maybe more considered a lift and shift, an expansion of an existing program, and those will all naturally have additional cycles of development and testing and validating counts. People on process changes. If you're able to take the capability and align it with something that is new and not available in your marketing stack, that is going to help expedite the value. And then further, you also need to have the data, right? Is it the latent? Is it something where you can ensure that the use case lines up to the speed of which that data is available in AJO? Is it hygiene? Is it good data that you can leverage to orchestrate an outbound experience to your customer? These things are pivotal. And AEP allows you and gives you the flexibility and a lot of tools to ingest some of that data into platform. One of the newer features that I'm going to speak to here in a moment, Federated Audience Composition, is a way to expedite some of that in getting your data to a point where you can activate on it.
So what is Federated Audience Composition? So first and foremost, before I get into what it truly is, is it's going to extend the value of Adobe Journey Optimizer. But what it really is, is it's a next gen audience building tool for you within Experience Platform. So this is for ultimate and prime customers and requires an add-on for federated audience composition. But what this begins to do is leverage the concept of zero data copy and hooking into your external data warehouses, your cloud data storage environments, where you have a lot of this data that already exists, right? You've structured it in a way it makes sense to you as a marketer to activate on.
Depending on the use case, rather than pushing that data into platform, you're actually able to leverage the data in that data warehouse with zero data copy. And I'll explain the workflow in a moment, but it gives marketers a friendly user interface after some technical setup to actually leverage that data and build audiences and also enrich audiences with some of those attributes or information that exists in that warehouse, and bring them into Adobe Experience Platform for activation, both in Real-Time CDP and Adobe Journey Optimizer. So that gives you an expedited way to start to activate on an audience, right? We've given you a head start rather than all of the development effort that it takes to bring some of this data and stream it into platform.
So like I mentioned, it's a one-time technical setup of basically hooking up AEP to your external data warehouse.
You select the tables, the schemas that are applicable for your marketers to go about building an audience. And then this marketer friendly user interface allows the marketer to take advantage of that data, right? It's still in your existing warehouse, but you're in Adobe Experience Platform, and you're querying, you're filtering, you're ranking, you're identifying who is your target audience. You can elect to add some attributes, maybe their birth date, something like that for a birthday message. You can enrich and associate that with that audience, save the audience, and it makes it available in Real-Time CDP in near real-time for activation, not only in the destinations of Real-Time CDP, but also in Adobe Journey Optimizer. So I would advise, if you would like to learn more about this feature, there is a lab tomorrow at 08:30am. It is full, but I'd highly recommend if you want to get more into how that works, there is a lab available to get a little more hands on.
So you identified an expedited way of bringing data, and activating on data. We've talked about the use case selection, and maybe you've identified your use case, and what's available in early in 2024, what was made available in Adobe Experience Platform is use case playbooks. These apply to both Real-Time CDP, audience activations, if you will, as well as Adobe Journey Optimizer. There are use case playbooks that involve journeys and journey activation. So maybe you've identified your use case as a marketer to prioritize, or maybe you want to use this use case playbook as a thought starter. There's 40 plus turnkey playbooks. They span across industries, they span across channels and business outcomes, and you can either leverage that as a thought starter or align it to the use case you've already prioritized. What's awesome here is this is a great interlock for the marketer and the technical persona who has to ultimately build and test and execute the journey get it to activate, because it allows the marketer to select that use case they're interested in. And then there are technical assets, journeys, audiences. There are schemas, AEP schemas, that are basically built as a result of selecting that, and they end up in what's called an inspiration sandbox for you to start to configure specific to your environment's needs, right? You might have a custom schema for your transactions or your web events. You're able to map that to the use case playbook template that was provided. And so again, all of that happens in a lower environment, and then you're able to package that all up once you've made those modifications and put in your production environment for further testing and preparing for go live.
So what's upcoming in April is a beta program for playbook authoring, so bringing your own playbooks. This is something that as we have available in April, it might be something we might leverage to package some of those journeys and those templates that we mentioned earlier up for easier activation into the 30 club sandboxes. But what this is great for is if you are a center of excellence and you have multiple business units that span different sandboxes or different orgs, IMS orgs within Adobe Experience Platform, these use cases, once you select them, can be brought into those different orgs or different sandboxes. So as a center of excellence, you can define what that template should be, and then you can allow your business units to pick and choose from there and take those same steps that I just mentioned to eventually propagate it into all that sandbox, for their own needs, for their own business unit. What's also coming with this feature is being able to prompt using AI Assistant and prompt to generate your own use case playbooks, your own mind maps, descriptions based on what you're looking to do, and eventually also being able to build out those technical assets, the audiences, the journeys that align to the use case that you've prompted in AI Assistant.
And so finally, to activate. How do we want to accelerate activation within Adobe Journey Optimizer? One way to do it is through custom actions, and leveraging your push, your RCS, your email service providers that you already have today, where they don't have the one-to-one journey orchestration capabilities. So you leverage AJO first to do that orchestration, and then eventually layer on native authoring, native deploy in Adobe Journey Optimizer. All of the journeys that we saw today and what we mentioned early on with the capabilities for the ticket scan, those are all using custom actions. We're able to make these journeys, those custom actions look and feel, allow the journey practitioners to route and configure that push notification all within a custom action. So this is a great way to accelerate your time to value. Most of your applications will have a means to send through an API, all this information, and is a great way to accelerate time to value.
So, Ken, I'll hand over to you to help wrap things up. Yeah. Wrapping up here. We've talked a lot today about some really big AJO wins. MLB helped find those wins by selecting those right use cases upfront. It really helped us expedite this whole process and be able to scale this out across all the clubs, and then find those early wins, that 2023 early on season when we started testing all this. It was great to see the positive results we're getting, and that really proved to us that AJO was incredibly powerful and impactful for us, and we needed to continue to figure out how to appropriately and just expand upon everything we're all-- Or use it to expand everything we're already doing. So we've seen a lot of great success, and we are very excited to see where this is going to continue to go.
And we've also given you some tips to accelerate your use case prioritization as well as how to actually activate those use cases once you select them. So with that said, don't forget to take the Summit survey for this session. Thank you all for your time today. I hope you have a great rest of your Summit experience. Have a nice day. Thanks, guys.
[Music]