MiaProva has delivered considerable value for organizations through our notifications as events happen in MiaProva and when there are issues related to their Activities that are Live in Adobe Target.
We’ve now expanded on that ability to Microsoft Teams. Now, organizations can update one of their Teams to get a real-time feed when a new Activity is submitted or archived, a negative lift with confidence has been seen, a sample ration mismatch has been detected, or any other of the many events that MiaProva monitors.
The video discusses the integration of MiaProva with Microsoft Teams, which allows for notifications related to workflow and performance events in MiaProva to be sent to Teams. The notifications can be configured based on roles within MiaProva and can also be sent to Slack. The integration is straightforward and notifications appear in a separate channel within Teams. The video provides examples of the types of alerts that can be configured and how they appear in Teams. A daily aggregated alert is also provided. Viewers are encouraged to ask questions if they have any.
Transcript:
(00:00) this is a quick video outlining the integration Mia Prova provides with Microsoft teams so those of you familiar with Mia Prova are aware of all the notifications that we provide via email via slack and now via Microsoft teams so these are a combination of workflow related events like if an activity is ready for QA if a ticket is being archived if there’s been a bug you know things along those lines a typical workflow for a test or personalization activity being configured and we also provide performance related uh
(00:37) notifications as well when the code has been changed in Adobe Target the kpi metric is above or below the threshold and we also send out a daily aggregated alert as well and so these can be configured by roles within miaprova but also they can be sent along to slack and Microsoft teams the integration to teams is very straightforward it’s available within this part you would get this information from the documentation that your Mia Prova account would provide and what that would look like within Microsoft
(01:11) teams is exactly like this so you’d have a your whatever teams that you’re using today there’d be a kind of Channel within it and you whatever alerts or notifications you configured within your Mia Pro account would flow right in here you can see some alerts related to sample ratio mismatch you can see here that’s missing an estimated to have completion date all related to whatever you configured for your particular account so you’ll also get a daily aggregated alert with everything that’s
(01:43) going on across the activities that are live but here you can see performance related alerts where you could see that no success events in the last 12 hours and things like this and these are always very these are specific to the journey that was configured within Mia Provo so if there’s any questions please let us know
Historically, MiaProva would only provide Adobe Target usage reports from when they started using MiaProva. We have since changed that and now provide reporting on their usage of Adobe Target since they started using it. Many of our customers have been using Target since 2010 or even earlier!
The video is about a new feature in MiaProva’s last release which allows customers to view year-over-year reports on how they are using Adobe Target, including activity throughput. The report filters can be applied to exclude QA activities. The feature has been updated to go back to the beginning of the company’s relationship with Adobe Target. MiaProva’s tools for efficiencies and scale have helped many customers to run lots of activities year over year. The speaker encourages MiaProva customers to check out this new feature.
Transcript:
(00:00) here’s a quick video on a small little feature that we incorporated with our last release that a couple customers that provided a few that I saw that was super cool so I thought I’d do a video to show so um what you’re seeing here is um just a report in terms of how you’re using Adobe Target and year over year um reporting in terms of activity throughput and historically what we’ve done is only started the year of the graph when Mia Provo when the company first started using miaprova but we’ve
(00:33) since updated to go back all the way in time since the Adobe Target relationship at the organization started and so I thought it’d be interesting to kind of show you know some of this so here’s here’s an organization using Adobe Target since 2010 you can see the kind of the progression year over year so MIA purple customers give this a look um your report filters that you apply within here so when you want to filter out activities like QA that’ll apply on the data set as well so you can you kind
(01:02) of see your company’s growth and the companies that are doing like lots of testing as you see here Mia Prova obviously helps with this you know with our standardization our tools for efficiencies and scale and so you’ll see a lot of companies out here that’ll have lots of companies or lots of activities run year over year and me and Prova is playing a big role in in helping scale that out here you can see some of these customers you know a thousand activities year over year um you know some years less but then you
(01:37) know so far this year 223 different activities 1809 activities last year so exciting stuff Mia program customers go ahead take that a look um thank you
MiaProva has added new features and functionalities to their platform, including a fully operational integration with Jira and Adobe Workfront. They have also added the ability to download all data related to any live activities, subscribe to specific journeys, and limit notifications to certain roles or journeys. The Jira integration allows customers to connect data from Adobe Analytics and Adobe Target to Jira issues, automatically creating a MiaProva program that maps to all the data within Jira. Similarly, the Workfront integration automatically creates a MiaProva program that maps to the fields of the project. MiaProva has also added the ability to customize what fields show up in the side panel within the program section of the status board.
Full list of updates:
– Download Swimlane information – Program and Journey Specific Notifications – JIRA – Workfront – Side Panel configurations – Field length for multi/single select values – Updated Template for Email Summary – Add Naming functionality for Creative URL – Updated Text on Home Page for Activities – Removed drag and drop for General User type – Various performance enhancements – Images sorting
Transcript:
(00:00) it’s been an exciting couple weeks here at Mia Provo we’ve been really really busy lately building out new features and functionality and a lot of it has been released over the last couple weeks within me in Provo including um some significant ones over this past weekend so excited to report we have a fully operational wonderful integration with jira and Adobe work front I’m going to have more content videos specific to that because they were pretty big enhancements to the platform but I want to just catch you up on some of the
(00:30) other features and functionality that has been added to the platform uh we’ve added the ability to download all data related to any of your live activities so you’ll notice on our live dashboard you can download all of the live data and this will be the same activity data that’s available in the swim Lane management section within miaprova so it’s it’s a great report and a couple customers have asked for it and it’s very very helpful you can see a list of all of your live activities when
(00:57) it’s went live uh when it’s ended how many visitors are in the activity and audiences to really really help with test interaction help turning off old activities that are currently up and running so that is uh in production uh both on the live dashboard as well as the swim Lane management section of Mia Provo you could download this information within here additionally we’ve added functionality to subscribe to specific Journeys so MIA Prova as you as you know has a rich set of notifications that go out based off of
(01:30) different events happening to ideas to activities based off of user roles um and as you know the different roles within Mia probably have different levels of permissioning but not ever not in an organization needs to know um that a ticket has been submitted unless it’s specific to their business unit and so we’ve added functionality in here where you have the the ability to filter or or limit notifications to certain roles but also extended that to Journeys as well as programs so you could come into Mia Prova select with
(02:04) Journeys and what programs you want to subscribe to for all the different related alerts of course if you’re tacked in any comments you will continue to receive those and you can also update what specific uh alerts you want to get updated for for the um related to metrics or issues like sample ratio Mitch Match you can you can update your individual level settings within there the jury integration like I said we’re going to have more on this in a more deeper video uh pretty impressive uh you simply add the integration
(02:38) through here like I said there will be more on this you can see the jira issues and in terms of what the permissions we need uh AGR admin would simply install the application then we would go into here you’d be able to select what project you would like to have um where the jira issues get imported automatically into Mia Prova choose what issue type within jira and then what status you would like it to be ported over to Mia Prova and then you can say where in me approval you would like this to go and what we do there is
(03:12) pretty powerful we automatically create a Mia Prova program that maps to all of the data within jira and so for those customers that have already put this integration in place they have a fully automated uh Mia Prova system where they’re connecting data from Adobe analytics and Adobe Target to jira issues which then gives you the ROI for all of that data for all of those different issues within there the jira programs you’ll see with it will show up within here based off of whatever the issue type is and the project within
(03:47) jira the workfront integration this was a huge huge integration we built this for one of our bigger customers very excited to see that you’ve got the different information here for the certificate and you select the program so very similar to jira but program represents kind of like project in the jira world what status you would like it to be ported and then what state you would like like it to go over to Mia Prova and just as we do with jira we automatically created me a Provo program that maps to those fields and so automatically as new
(04:23) um you know tickets or projects within jira are Korean created they are automatically ported over to Via Prova where you then can correlate them and Associate them with any of your live activities really really powerful stuff where you can see all of the different activities being ported over and you can see all the details for that uh project are automatically ported over as well really really powerful because for both jira as well as the workfront integration all of the data that’s available within the the particular
(04:55) issues or projects from the respective Solutions are available here to construct reports some based off of you know whatever type of things whether it’s location the the analyst being assigned idea Source really the sky’s the limit so any one of those variables becomes available for um configuration while I’m here at the status board this is where a lot of things are managed within here organizations can manage Things based off of you know their different programs and and all that rich data but additionally
(05:28) what we’ve added here over the weekend is the ability to customize What fields show up here in the side panel users have been able to configure what tickets are required across the various States all of that is done within the program section within here so you come to your particular program you’ve got all of your fields that are there you can even come into your uh your automatically created programs from jira or workfronts and you can come here and you can update with any of these different things you can uh enable this
(06:00) let’s say priority is one of the different fields you can display on sidebar or make that filterable so it’s really easy to make it available here and by making it filterable so this is a workspace Simply Save that update within here we can go to the status board we can then filter on our programs from workfronto forget which work thing I put within there so you see these particular projects but then you also see the priority be able to kind of use that Mia Provo will also then correlate this information with any of your metrics as
(06:32) well so you know if you think about you know the um this data or you can look at uh you know the the win rate by idea Source things along those lines uh that that’s available within here so that was a big update adding that functionality so you can kind of see it here on the side panel we’ve also made some updates to the uh awaiting summary uh email template so within me and Prova come within here so you got all of the data from the tickets you’ve got the real-time data that comes in from Adobe you can see it’s getting an updated
(07:07) information based off of the journey uh within Mia Prova but we have the the send summary email section so one of the things a lot of our customers like is instead of spending the time I could see like the variance in the data here instead of spending the time putting together a results deck Mia Prova provides templates where you can see everything and anything that’s associated with the ticket whether it’s screenshots uh all of that is available for the email summary so you can quickly and easily send emails out based off of
(07:39) uh based off of the data that’s associated with the ticket we also added naming functionality so this was a thing from one of our customers where you can come into here for tickets that are under development you’ve got assets uh and So within here you can add in different new URLs but now you can add associate names with it to name them and it’ll update the names accordingly within there we updated some text on the home page here so this used to say total test but the Adobe Target users out there know
(08:14) that they’re not call tests in Adobe Target and Tess has kind of a meaning where you’re kind of like doing like a b testing and uh a lot of companies are using Adobe Target for much more than that targeting personalization um patches operational ish things and along those lines so we just updated the naming convention within here to be respective of that we also on the status board we added functionality to actually we took away functionality so one of the different levels of user access is called general public and this is the
(08:51) permission level that all of our single sign-on as well as jiren workfront customers use where the that role general public is associated with which which is kind of like users that don’t need to create tickets or modify different things and so the general public can no longer drag and drop the priority so this is a is a function that’s used a lot by test managers where you can come in adjust the priority at a global level as well as an individual journey level um very similar to the uh functionality
(09:25) within here where um uh test managers and administrators can adjust priority within here so we took that functionality away from the general public on the status board um we also had various performance enhancements I’ve got a smart team of Engineers that are always looking for ways to improve on things and so there’s a lot of those very technical things where the updated performance and then last here a very simple last thing I want to highlight here is the ability to kind of sort imagery uh that it was
(10:00) something one of our customers asked for the ability to do I’m just looking for an activity here with with imagery and I’m in a demo account here so within here you can adjust the images so that’s it for this last couple week like I said there’ll be upcoming videos going deep dives into the jira Integrations as well as the workfront integration but as always if there’s any questions or anything we can help you all with certainly let me know thank you
MiaProva is excited to release two significant features as part of our October 2022 release.
First, we have Audience filters. On MiaProva’s Live Dashboard, MiaProva’s Status Board, and on our Program Overview, users can use any of their Audiences used in Adobe Target as filters to manage any of their Live or Archived Activities.
Secondly, we are introducing Charts Builder and Charts. Here, organizations can use their Custom Metrics in MiaProva to configure Charts based on any Goals or Targets they want to apply to these Metrics. All of their MiaProva Custom Metrics are available for goals and the Archived Activity Count. And all of this is correlated against your MiaProva Journeys!
In the video, Brian Hawkins from MiaProva introduces two new features that have been released in the Mia Prova platform. The first feature enables organizations to manage all their activities by their audiences. This feature incorporates audiences, whether it’s used in Audience Manager, Adobe Analytics, or Adobe Target, allowing organizations to manage all their live activities by these audiences. The second feature is the chart builder component that reflects custom metrics, allowing companies to create a visibility of what their program is doing in terms of archival by Journey. Mia Prova automatically collects Adobe data per journey, but the feature allows the addition of different organizational KPIs. The chart builder makes it easy to define the charts based on custom metrics or experimentation goals.
Transcript:
(00:00) hello Brian Hawkins here from Mia Prova here today to share with you some new and exciting features that we released in production in the Mia Prova platform so the first one uh I’ll jump over to an account that’s connected to Adobe the first one’s pretty exciting it allows organizations to manage all of their activities by their audiences so for those of you familiar with Mia Prova we have the Adobe Target activity data where you can use to manage things you can also manage by any of your internal data here Journeys
(00:33) programs developers as well as any of your custom filters within Mia proa as well well based off of uh some some very good customer suggestions we’ve Incorporated audiences so now you can use any of your audience data where automatically whether it’s used in audience manager it’s a segment from Adobe analytics that’s being pushed over if it’s if it’s being used with Adobe Target it is available and you can kind of manage all of your live activities by these particular audiences this new
(01:03) feature is also available on the status board where you can come in here and kind of look at what audiences are being used and this is the first step in in some of the cool things we plan on doing with audiences in in the months months ahead but very very helpful especially if your organization is well organized with audiences it’s interesting we see uh companies with hundreds and hundreds and hundreds of audiences with many being the same thing because there’s lots of different ways to Define things but here
(01:36) you go an ability to incorporate audiences as part of your activity management we also have that available on the program overview if you want to see what type of audiences were used as part of your historical activities and of course all organizations have the ability to look at all of the audiences that are in any live activity in the swim Lane management section of Mia Provo where we not only show the audiences coupled with any activities but also the distribution of traffic as well as the start and end dates for activities
(02:08) the next feature is a very very exciting one I’m very thrilled to announce it and share with all of you here today this is this charts and charts Builder component that you see over here on the left hand side and you’ll notice I went to the Mia Prova admin Council because the charts and the chart Builder reflect custom metrics so with every new onboarding within Mia Provo you know after we get the connection to Adobe in place we’d like to help the organization Define Journeys Journeys is another section up
(02:41) here towards the top underneath organizational setup but as part of those different uh Journeys we like to incorporate one of the top level kpis what are the different organizational metrics that you want to include and have part of your broader organization dashboard and so we’ve got some ones that are built in but every company comes in here and customizes uh this any which way that they want all of these uh test metrics would roll up to the test metric goal so you’ve got like a macro View and a micro view I think Revenue
(03:15) amount percentage and some average weighted average and Mia Provo will automatically look at the visitor count or impression or visit count whether you’re using a for t or non-a for t to help with the weighted average component and so with every activity that gets archived so I’ll just show you this process here really quick so the this this area represents activities that that are currently live and running or they have recently ended you can see or they don’t have any activities that are associated with the tickets uh
(03:47) nonetheless all of these tickets are available within here we have the uh let me actually grab this one’s got a program that doesn’t have that data here so actually let me just sort for a program I’ll just use Mia probably default because we know four so yellow CTA I will just choose this one here so this is an activity this is a ticket we have uh we’ve got the uh the Adobe Target data that’s being pulled in right now because we’re going to create a permanent record of it and it’s actually
(04:16) applying a segment on top of it but not the point of this uh this video so all of these different custom metrics at the at the end of the activity you want to associate different organizational kpis and this is where you would you would call that out within here again we automatically collect the Adobe data per Journey but this is the additional data you’d like to augment the activities with and so as these are being updated and you you archive the activity all of that data gets updated on the program overview so you can see all of the data
(04:51) being updated based off of that and each organization is different this is an account that we use that’s connected to Adobe but you can see here we have another demo account with different metrics based off of different types of Journeys that have been defined so bringing in the charts and the charts Builder I’ll show you how that comes together so the charts Builder within here you can Define the charts based off of any experience any of your custom metrics or experimentation goals we make it very straightforward so all
(05:22) of your different user-defined metrics will be available here as well as the total number of archive tests which is something quite a few of our companies or customers have they wanna they wanna set charts or create a visibility in terms of what their program is doing in terms of archival by Journey so I’ll go ahead and show you that and how that comes together so I’m going to set up a custom metric total number of archive tests I can add in different Journeys let’s say I’m United Airlines and and my
(05:52) Journeys are Premier 1K Premier Platinum premiere of silver uh let’s see if I got any others let’s say I want to create a goal of 7 35 archive death activities for these three Journeys over this last fiscal quarter assuming they follow the same fiscal quarter as the calendar so I’ll add that in here so I created just now on the fly a total number of archived tests for one two three specific Journeys within Mia a goal of 75.
(06:26) so I’m just going to call this United Airlines goal of 75 activities uh you can do it based off of gauge or progress bar I’ll just choose progress bar right now and then I will choose the metric that I decided to use within here so you can see here this I did this on the Fly um be this isn’t an account that’s connected to United Airlines um but as activities are being archived all of those would be represented within here so you can improve this particular chart and this chart would come over to this chart dashboard uh the sky’s the
(07:04) limit in terms of what organizations can do with this all of their different goals are available within here they can look at the charts by Journey who’s the author and I should call out only only test managers can approve uh different charts so anyone with a general public user role can come in here create a particular metric associate it with a with a particular chart and ask it so I can just do demo chart and let me just choose a goal so you can see it’s save obviously I have a a test manager user role so I was able to approve it
(07:45) but they can submit it for review um and so there you have it just a quick overview in terms of all the different charts we have a very exciting addition coming to this very very soon that’s going to even make this even more powerful but you can see here here’s an example where I’ll actually go over to the program overview I’m going to open a new tab so you can kind of see how this comes together so in um in this particular uh me a Provo tenant we’ve got 3.
(08:17) 5 million but let’s actually filter the metrics for this year so in 2022 uh the testing program Associated 3.45 million dollars uh for some of their archive tests now I’m going to come over to the charts section over here on the left and we can see here we have a particular chart where the goal was 5 million and so here you can see the 3.45 million with 1.
(08:47) 55 million left to go so you can export it which is nice and easy as as an image or PDF but there you have it a wonderful way to quickly and easily set custom dashboards priced off of organizational metrics or goals in terms of archived activities
Organizations connect their Adobe Target and Adobe Analytics accounts to MiaProva via Adobe I/O. MiaProva provides a digital certificate to organizations to upload to Adobe I/O to make the connection happen.
After 12 months, Adobe automatically expires all certificates. MiaProva sends out an alert when the certificate expiration date is nearing. This video shows how to download a new certificate from MiaProva to upload to Adobe I/O, which extends the connection for another 12 months.
as you may know mia provo does a lot of
its magic by connecting to adobe io
and how we make that connection with
every new tenant is we provide a
certificate so i’m in the admin console
to be improva
jump over to the test setup section
so you would download this certificate
this is your adobe target
client id and this is your adobe
analytics api id as well which are
available within the respective accounts
but what i wanted to highlight here is
just how to update the certificate in
adobe io
when the certificate is initially
uploaded it is good for one year or 13
or 12 months and then automatically
expires
mia provo provides notifications
when these uh alerts and notifications
when um
the certificate
is is nearing that expiration date adobe
sends out notifications as well and so i
want to show you how how we can update
it to a current adobe io project so
simply log in
download the certificate that will
automatically generate a new one for you
and then you would go over to adobe io
so all of your you would go to
console.adobe.io you’ll be redirected to
the
developer center here and make sure
you’re
connected to your organization a lot of
adobe admins have their own um you know
different project areas for their own
little projects but you want to make
sure you have the organizations and to
make sure that you’re the system
administrator then simply go to projects
and we could go
let’s just pick
uh this one a prod
so this is our project
and you can see our two api connections
here adobe analytics and adobe target
and this is our credentials
jwt
and if i scroll down you can see in this
section we’ve got two previous
certificates we’ll just simply add a
public key
and then i’ll upload this certificate
right there
oh it’s uploaded the certificate because
i’m already in use but but you kind of
get the point you just simply update the
certificate and then mia proves
automatically updated and we’re able to
continue things uh within here with a
connection to adobe analytics
as well as adobe
sorry adobe target and as well with
adobe analytics as well so that’s it if
there’s any questions or anything please
let us know
This video provides a brief overview of the Tools section of the MiaProva application. Here you can see some of the tools we provide in MiaProva, including our popular Chrome Extension.
hi and welcome to mia provo we have a
series of videos
for users to familiarize themselves with
the me approval user interface videos on
best practices within me approva
onboarding videos as well as me approval
case studies this video is part of our
user interface review and we’re going to
focus specifically on the tool section
within here within mia prova so i’ll
start off with the chrome extension this
is a very popular tool in the adobe
target community
uh you can click on this it’ll open up
the app in the chrome store you can see
it’s got well over a thousand plus users
and it’s it’s something that is not you
don’t need a mia pro account to access
it
but once you add it to chrome you can
quickly open and close it by way of this
toggle and you can also disable it by
clicking on
this bird in the top of of the
chrome extension toolbar so yeah very
very helpful within here um i’m signed
in
i’m signed in i’ll actually uh i’ll stay
signed in and then i’ll show you the
signed out view so the uh activities you
can see all the activities that you’re
in in this particular location
we also
provide real-time reporting like where
the test is running
uh and based off of the default journey
view and all that and all the lift and
confidence intervals all of that’s
automatically constructed on the fly
whether it’s a for t or not a for t data
so
really cool where the tests are running
you can see active reporting um and it’s
updated like i said uh in in real time
i’ll actually grab an a for t1 within
here let’s see uh let’s do this one
that’s the activity metadata
uh but you can see access to to the
reporting uh within the chrome extension
all of your activities are within here
so this is something i use to actually
push this
bulk updater tool uh to the page which
is really cool um all the activities
that are running on the location you can
see what mbox what experience name what
what’s offers are being used um all
sorts of of good stuff as well as a
breakdown of all the offers that are in
place and what selectors are used and
all that good very helpful stuff for
adobe target practitioners
you can also upload screenshot or images
of the test directly to your mia provo
ticket which is really cool
you can see your adobe target profile
probably one of the more most valuable
things of the adobe target platform the
profile
you can see your first party id that
you’re passing to adobe which if you’re
not you absolutely
should do
um
this is the adobe target visitor id as
well as the experience cloud id that
stitches adobe audience manager adobe
target adobe analytics together which is
very cool you can add ideas directly
from the chrome extension um
uh into your mia pro account labels and
journeys and all that good stuff within
there uh reporting um these are just all
the activities that are in your account
if it’s live you could come in here and
quickly and easily just get a quick
snapshot in terms of how that activity
is doing and when you see
the loading here that what we’re doing
is getting an updated um
updated data and if it’s a activity has
been along for live for a long time it
could take a while uh a few seconds like
you saw there but really great utility
is completely free uh for the adobe
target community so i signed out here
and so now you can you can see the
reporting and uploading of images went
away but you can still see profile
attributes you can add attributes for
your targeting which is helpful but
you’re unable to add ideas and reporting
um mia provost supports single sign-on
within the chrome extension as well
which is really helpful so you can
quickly sign in this is our domain mia
provost supports single sign-on right
within there
so i’m going to our single sign-on
logging in within there
there it is
and
you know the password
and boom
so i’m uh being redirected to our portal
and you can see that the chrome
extension signed me in as well which is
nice it’s an example of our chrome
extension um
sample size calculator
you may have to remember this from the
this section the create managed tickets
where
you can have a field to provide your
sample size
and me approval will automatically track
that so here’s another way to kind of
see the sample size as well
swimmer management i’m actually going to
jump into a live account because this is
a demo account with with kind of fake
data here so so here we have
this account i’ll go to the swim lane
management
and here we can see all of our
activities so this is a very very
popular feature of mia provo a lot of
our customers love this because
they get the visibility in terms of what
m boxes are being used if they’re using
modular m boxes they can see what
audiences are being used will
automatically consolidate uh refinements
which is a part of the audience as well
as the audience that was included within
the activity you can see the
distribution of visitors that are using
the same mbox
and the visitors today so this is very
very helpful to see
what might be cannibalizing traffic of
another activity what activities that
are still live that shouldn’t be out
there we show the start and end date
really really really helpful uh
functionality that we provide
um within here which is pretty cool so
you can see a swimlane of all of that
and the these things on the left
is a shortcut to your adobe target
account which is pretty cool your adobe
analytics account within here
um
so you can access and get into your
adobe target account um the help section
which is cool you can see a breakdown of
some of the different videos that we’re
updating and adding to this and then
lastly adobe api this is something that
we use internally here we can kind of
see some of the different uh endpoints
that we’re using um
to do the really really intricate dance
behind the scenes in terms of using
adobe analytics in context with adobe
target so really cool cool stuff within
there so that’s the tools section of mia
prova um if there’s any questions please
don’t hesitate to
to let us know
and thank you for watching take care
When organizations start using MiaProva, they are asked to define Program metrics for Program Visibility. MiaProva will automatically manage the calculations behind each metric with each Activity archived and added to the Program Overview.
This quick video highlight what some of our financial customers are doing with the metric of Application Completes.
hello and welcome to Mia Prova this
quick video is to demonstrate some
special use cases where organizations
are using the aprova to provide program
visibility into organizational metrics
and so uh this is one that’s specific I
would say primarily in the financial
industry but you can apply to lots of
different Industries so let me be clear
Mia Prova has absolutely no relationship
with Bank of America I’m using it
because they’re down the street for me
and I think it demonstrates this use
case nicely but again no relationship
with Bank of America no clue if they’re
doing this but I suspect that they
probably might be so testing teams at
Bank of America have lots of different
goals they probably have testing
programs targeted to unknown traffic to
prospects to different types of
customers and there’s varying success
events but one that probably spans a lot
of the different uh road maps is new new
accounts account completes that sort of
thing for all of their tests that are
targeted to prospects and so what in Mia
Provo what such a financial industry
would do is they would go into our admin
Council within here they go to test
setup and I should add Mia Prova as part
of onboarding we work with you all to
Define
what what program metrics make the most
sense and so this is one that we often
use with a financial industry so a lot
of here it’s different configurations in
different settings within Mia Provo but
I’m scrolling down to test metrics so
let me just add in a new one and this
will be application uh application I can
type application completes
okay application completes and we’re
going to make this an engagement goal we
are going to make it an amount and then
we’re going to do total sum and then hit
add so now this is a
a metric that is available for us when
we archive activities okay so the
program overview this is where all the
activities live when when they are
archived you can see here there’s zero
they haven’t been added but we have 14
activities that have been archived and
collectively this was their program
impact against the different
organizational metrics you can refine
based off of locations and all that
wonderful stuff as for those of you
familiar with the
um the program overview page but I’m
quickly going to jump over to manage
tickets awaiting summary
so I’ve got all of these tickets within
here so let me just grab this one
and so we have all of the ticket
metadata that’s available
again that could be customizable as
needed we can we’ve got the the data
from Adobe Target uh within here
um any commentary the day by day graph
but I could say the learning uh
uh visitors
this is fake so visitors respond well
to get started
versus start now
and you know you put in additional
commentary
the location you can say a home page the
outcome let me say this was a
significant win any analysis
um but then we go over here here’s all
of our particular metrics I’ll add
application complaints and let’s just
say we have
125. so this would be the net so what
what some Financial organizations are
doing in Mia Prova is is looking at the
Delta Mia Prova will automatically grab
the data and let’s say this was the
Delta here and we wanted to just
calculate okay 125 what have you so
we’ll automatically grab all of that for
you but if you wanted to apply your own
data sets or what have you for it so you
can do that you can simply let’s say
archive it let me uh let me actually
save it
I can send a test summary email out with
all of the particular data and the
impact and all that good stuff but let
me go ahead and archive it and so now
now the test has been archived and if I
go over to the program overview
you can see here 125. so this is a
little best practice tip where you’re
you’re really providing visibility into
all of the test impact and and again you
customize this by me a Prova Journey
where it’ll defaulted to the particular
metrics and the the math is customizable
Mia Provo provides aggregate summation
you can do weighted averages
non-weighted averages raw counts lift
um are just kind of uh average lift so
thank you just a real quick video any
questions or other topics it’ll be
helpful to have and Mia Provo let us
know thank you
This video provides a brief overview of the Create and Management Tickets section of the MiaProva application. Here users can create tickets, manage them across the various states, manage ideas, and have visibility of Adobe Target Activities and MiaProva tickets on a calendar.
hello and welcome to mia proba we have a
series of videos for users to
familiarize themselves with our user
interface videos on best practices
within mia prova miya prova onboarding
materials as well as me approval case
studies for some of our clients the
video that i’m covering right now is for
our user interface specifically the
create a managed ticket section
available in the net left navigation
here
if there are any questions uh or topics
that would be helpful to cover please do
let us know in the comments
or email us at support miaprova.com
and please be sure to follow us on on
youtube as we
share me approval updates there as well
as other helpful items related to our
industry and other tips and tricks
related to adobe target
okay so the grade managed section within
mia provo is available in the in the
left navigation
because of the breadth and depth of the
miyaprova application we decided to
break things apart in in a series of
videos so and so right now i’m going to
cover this section here uh the homepage
is the default landing page when you log
into the application of mia proba uh we
provide a quick overview in terms of um
how many tests have been launched for
the current year this is something we
automatically generate just by
connecting to your adobe target account
we provide graphs in terms of the
distribution of ticket status whether
it’s submitted under development or a
waiting summary
this gives a quick view
of the tickets across the various states
the live column is something that gets
automatically populated from either
adobe target or adobe analytics it’s an
adobe fed column where we highlight all
of your activities give directional
input um
and the lift for the for the given
journey that the test belongs to
here you can see uh the tickets that are
currently under development which ones
are have been submitted uh and and are
assigned to be developed next and then
what tickets are uh currently awaiting
prioritization
this is
more often used in the status board i’ll
show that in a subsequent video video
the featured test story this is
something that users can
decide
which one they want to be the featured
test story often organizations will look
at their program overview a lot of their
historical tasks or if they
uh decided to you know they had a really
interesting test that was recently uh
successfully
uh archived and some interesting
learnings they can make this featured
within here and that would show up on
the homepage as well in this featured
test story uh latest happenings this is
where you can get a feed
of what people are doing this is a demo
account so a lot of this information
isn’t super exciting but you can see
things like there have been comment um
uh there have been comments that have
been added new tests have been added or
created tests have been archived uh all
the typical workflow stuff that exists
within the media proper application
and the last thing here on the home page
is just a quick overview in terms of
kpi summaries
this is available as well as on the
program overview but here you can get a
quick access to look at things show me
all the tests that are running the room
on the home page and all of the data
will automatically update
it’s probably better used on the program
overview because then you can see all of
the activities or the tickets
that are associated with the with the
different dimensions
within here but we wanted to include
this on the homepage to give people
quick access to this
my ideas lab so
here or users can add ideas within the
mia pro application directly within here
or i’m going to open up a new tab
users can add ideas directly with our
chrome extension you sign into your
chrome extension let me just sign in
here
to do actually it’s mia
so here i am signed in i can add in
ideas directly within here associate
labels with it as well as journeys
information with the ideas um
so the ideas lab within here you can add
that you can also crowd source ideas
so mia provo we have single sign-on
capabilities
we have functionality where you can
easily invite users to the mi
appropriate application
you can share this and this is like an
anonymous uh
login or it doesn’t require a login but
we have some backend systems so it’s a
way to get ideas into the miyaprova
application um
for people to vote on and prioritize as
you wish so
this was a suggestion years ago one of
our very successful customers who wanted
to just quickly and easily get ideas
into the application so this is a nice
way uh to distribute and solicit those
ideas so that that’s something that’s in
the idea ideas lab
we also have all the ideas that have
been added within here i’ll show you
that in the vote for ideas section
but we also have like this pre
pre-ticket queue if you will where ideas
that you want to prioritize can be
provided and moved over to this
particular queue ahead of time
we also offer the ability to quickly and
easily take an idea that’s been
prioritized and create a ticket directly
from that everything in the mia provo
application comes down to tickets and
activities from adobe or other sources
and tying them together uh we’ll have
more more information on this program
concept
but i wanted to just highlight that
component within the ideas lab within
here
vote for ideas so all of the ideas that
have been added to the miyaprova
application
can be
viewed based off of label based off of
journey
what have you
we have a cool feature here that
provides
organizational visibility in terms of
what ideas are getting voted on or maybe
what ideas are being prioritized here
you can drag and drop an idea based off
of the level of effort and estimated
return
this is a weighted average so the the
more votes an idea gets the bigger the
bubble will be
it also if someone on your team voted
for the idea to be here that is a high
estimated return as well as a high level
of effort but then someone else voted it
for to be like this
collectively that would be within here
assuming two people so the more votes
and idea the more um obviously all of
the votes take into consideration where
that should live within here
kind of teasing ahead a little bit here
in terms of the status board you can see
all of the ideas within here and the
number of votes here you can bring in
additional commentary
to discuss the ideas prioritize ideas
based off of the journey or any other
type of data that you’d like to include
as well
so getting back to this section
submitting a ticket mia prova is a fluid
system we do not require tickets to be
submitted
ahead of time tickets can be submitted
across any of the various states
you can even keep drafts of the tickets
submit tickets here under development
awaiting summary you can even create
tickets
that are archived because miyaprova has
access to all of the activities that
have been run
in the last 180 days and that’s
something that we can even expand to
bring back
longer periods of time but the submit
ticket section here allows you to
quickly
change the program based off of what the
desired ticket is that you’re looking to
submit
and here this ticket will then go into
the my ticket section so the my ticket
section is tickets that you your account
has submitted and you can see your
tickets that you’re managing across all
the different states within the mia
provo application
there’ll be more on this status board
section but the difference between the
my tickets here and the status board
section here is the my tickets are your
tickets that have been entered you the
user that’s logged in within here brian
okay
now manage tickets
where everything is uh all the tickets
that have been submitted are available
here you can click on any of the uh
tickets that have been submitted you
have all the details of the tickets that
are there and all the different fields
any commentary tasks
custom fields all of this will be
covered in a video
for the miyaprova programs but all of
the data that was entered in under the
original submission is within here
including the ability to add offer code
you can assign it to a developer
within here so you assign it to a
developer and that would move the ticket
over to the under development state
within here
across each of the different states
you’ll notice that there’s this
refinement ability so any of the
journey information can be used for
refinement programs
developers that are being assigned any
labels that you would like to use or any
of the custom fields that are included
in your tickets
are available for refinement within mia
prova you can also expand this to give
yourself additional room
now we have a lot of large organizations
that are using mia prova and they’re
differentiating
their different teams based off of
programs or journeys or labels or even
different fields within their custom
programs within the aproba so this is a
wonderful way persist filters to have
those filters applied across all of
these various states within here so i’m
just going to clear the filtered state
within here
um
so submitted uh the test manager can see
all of the tickets group by journey and
again the manage tickets section is is
another view
uh but just during the kind of like in
flight so the the managed ticket section
is the submitted tickets under
development section as well as a waiting
summary within here but jumping back to
the managed ticket section so
once a test or ticket has been assigned
to a developer that ticket moves over to
this column here
you can see based off of the estimated
deaf completion period and the required
date we color code things um based off
of uh you know if they’re if they’re
past the estimated debt completion date
you’ll also notice that you can copy
tickets delete tickets you can copy a
link to a ticket to share it out
throughout the organization you can also
comment which tags people as well
so just as with the other
states of submitted and awaiting summary
you have different fields here which can
be customized by state so you have all
of the metadata any of the assets
qa is an important section that we have
within mia provo which is great so if
you could provide
any instructions to
get into the activity you could come up
with your own custom checklist within
here
provide qa urls
and by informing qa what that does it’ll
automatically send an email out to those
qa users
letting them know that this is how you
get into the activity
this is the url to get in so that email
just went out to those users in the
organization that have the qa role
they can then log bugs within here so i
could log bugs people can see the issues
that were reported
so you have this history of what’s going
on to make sure that everyone is on the
same page
this can also be
correlated with different uh qa
checklists a lot of our customers are
creating custom questionnaires did you
check the test and mobile did you check
in this particular browser did the
user experience team sign off so all of
this checklist functionality is is
available within here
but once once you’re in a good place for
the test if you know the qa passed and
everything
you can launch the test
you can upload screenshots within here
screenshots can also be uploaded
directly uh within our chrome extension
a lot of our customers use that simply
come up to any of these activities here
select the appropriate ticket and then
you could add in
the screenshots as you wish within there
but then the ticket goes over to
awaiting summary awaiting summary is
where tests
where tickets live
when the test is up up and running or
the test has recently ended or we we
were
we’re looking to gather our insights to
to to get ready to archive them and we
have additional functionality to filter
on tickets that where the tests have
ended the activities are still live or
if no activity is paired with a ticket
we also do that by color coding it gree
yellow which signifies a mitch a
mismatch between tickets
uh and activities within mia provo
and lastly here is the calendar section
of mia prova and
all of the data here is based off of
dates from adobe target as well as dates
from your tickets and so you’ll see here
is all of the activities
um that have a specific end a start date
and an end date um
mia provo likes to encourage the use of
sample sizes
really to allow
organizations to get the most throughput
so they don’t leave tess on longer than
they should have so a lot of our more
strategic customers they have specific
start dates and end dates with their
adobe target activities and you will see
that here you can see that reflected in
the date and time automatically here
under development activities this is
based off of the estimated dev
completion date as well as the the
required date from the ticket submission
this is a demo account but you can see
kind of what things are being developed
lastly here is evergreen activities
this is empty this account is not
connected to adobe
but this is where the majority of
mia provo customers activities live at
least initially uh upon connection to
mia proba all of the activities that do
not have an end date will fall up here
within the uh
under within the uh evergreen activities
section um and then lastly events uh
events you can customize what events
exist but it allows you to add different
events on the calendar so you can
visualize them if there’s going to be
maybe a pause and testing or some
development efforts that are taking
place
uh or anything marketing initiatives
it’s a nice way to kind of visualize
these events across all of your adobe
target activities that are currently
live on the site
so thank you that was a quick video
hopefully on the create and manage
ticket section within mia provo if there
are any questions regarding this hit us
up in the comments or uh shoot us a note
thank you
This video provides a brief overview of the Happening Now section of the MiaProva application. Here users can see all live Activities, any associated alerts, and real-time data for A4T and non-A4T Activities.
The MiaProva status board also provides management of all Live Activities and the MiaProva tickets across the various stages of the Activity lifecycle.
welcome to mia provo we have a series of
videos for users to familiarize
themselves with our user interface
videos on best practices within
miyaprova miyaprova onboarding and me
appropriate case studies from some of
the cool things some of our customers
are doing the video that we’re covering
here it has to do with our user
interface
specifically the happening now section
within mia prova
which includes the live test dashboard
as well as the status board if there are
any questions or topics that would be
helpful to cover or to elaborate on
please do let us know in the comments
below or email us at support
miaprova.com
and also be sure to follow us on youtube
uh where we share mia provo updates as
well as other helpful items related to
our industry and adobe target lots of
good stuff there on adobe target our
team is very very well versed in in that
technology
okay so the live touch dashboard is one
of the more popular components of the
mia appropriate application
it’s automatically generated so simply
by connecting your mia provo tenant to
adobe io
mia provo will automatically populate
this so as activities are turned on
within the miyaprova
within adobe target they’ll
automatically show up within here which
is nice
you’ll notice some of them are green
some of them are yellow yellow means
that we have an activity
that doesn’t have a ticket associated
with it so mia provo is all about
associating activities
to tickets where we then are able to
automatically create a knowledge library
provide default alerting default
report metrics things along those lines
which is very very helpful
you’ll notice some of these are green
mia prova adheres to industry best
practices when it comes to testing and
one of the fields that we have in our
ticket submissions that was covered in
the previous video
is if we were to provide uh the
estimated sample size so we have a
sample size calculator that will
automatically
come up with a particular value if i
enter this in here
enter the value you see that me approval
will automatically generate the required
sample size
and when tests are live and we have the
sample size data associated with it well
why that it is green we’re also going to
send you an alert via email as well as
an alert within the user interface
that the activity has met the preset
sample size here’s an example of
an above threshold
performance of an activity variation so
we highlight a lot of the alerts uh
within our application within here as
well as the status board which i’ll get
into shortly so this is a wonderful view
where you can see everything that is
live and also manage it against any of
your organizational metadata so in adobe
target you can filter by what type of
activity it is whether it’s a for t or
non a for t and you can you can do that
within here as well
but we also bring in all of the data
from your tickets so if you had
particular journeys that you were
managing different programs developers
being assigned any of your labels custom
filters like you wanted to you just look
at product managers um so really
anything
that you’re using internally can be used
uh
within here uh for for kind of better
and easier management of it you can also
search the activity for any of the code
that’s being used any of the adobe
metadata is available and it’ll be
mapped to the corresponding live
activities that includes the code too
which is really really helpful
clicking on some of these different
activities
you can see several things here we
default to the start and end date based
off of the adobe data we provide what
audiences are getting in we want you to
have quick and easy say oh okay who are
the particular audiences that are
getting in
whether it’s a for t or not a for t the
data is real time
which is very very helpful using the
same apis that you use in
analytics workspace
you can actually calculate the sample
ratio mismatch we do that automatically
but some of our customers wanted to be
able to play with that so we have a
little calculator there for that
um
and then the data is distributed across
the various experiences which is helpful
i i again this is real time but the
default view for this data
is 100 customizable uh that’ll be in the
videos with the admin console
specifically the the reporting
um and it’s journey specific so mia
prova is a journey-centric optimization
management platform so
if if you have customers that belong to
one journey automatically mia provo will
provide that default reporting view
uh for that particular journey the
metrics in in the configuration of the
data grid uh for all of your journeys
and all of the alerting that we saw like
within the performance all of those will
be
journey specific as well which is great
uh mia provo does a lot of other things
which is really really helpful we
calculate the uh lift and confident
confidence levels automatically so for
those of you that use the a4t
panel and analytics workspace i think
you’ll find this to be very very helpful
we also
provide mechanisms for
commentary so a lot of our customers
will
will add comments in here
when a test is live which is really
helpful
to provide visibility you could tag
people tag groups within here and will
automatically send those notifications
and what’s nice is this this rich
commentary during the in-flight test
will automatically become part of the
knowledge library so if users are
searching on different things
the activities that have that metadata
will show up within here
now
our team
many many years of consulting and so
while we love this
summary view of the data
we also default to
a day by day view where you can see the
data over time against your various
metrics that are specific to your
journey this is a
demo account so it’s kind of like play
data but this is very very helpful to
unders understand trends or particular
issues that might be going on with the
activity also really helpful to
demonstrate
statistical confidence you can show kind
of consistent behavior of experiences
over time
very interactive
grid where you can kind of play with
things as you wish and again all of the
metrics here are related to uh whatever
the journey that’s been defined in the
application
and then we also have the ability to
kind of have just quick screenshots
available within here
if organizations would like we could
automatically bring in the offer code
and make that available that’s something
we automate as well um but this is a an
option to use the screenshot so really
really helpful companies will come in
here they can see how things are doing
at a glance and all of these top-level
metrics
are reflective of that particular
journey all customizable within the
admin console
and i said earlier this is how you can
quickly and easily associate tickets uh
with activities and
one of the very helpful things that mia
provo does is we provide organizational
visibility into how companies are using
adobe target
adobe target in my opinion is is
probably one of the best content
management systems out there even though
it wasn’t originally designed to be
because it gives organizations and
marketing teams the ability to quickly
and easily target and change content on
the site or it will be using it for
patches or bug pitches or
operationalizing winners so this is a
wonderful way
to flag these different efforts okay
this is operational so we flag it as
such we’ve got the data with this we
save and then we just flagged it so now
reports can be generated for
organizations to show how they’re using
adobe target over time
to
identify
[Music]
opportunities in areas for growth and
things along those lines so we want to
make sure that everything gets credited
uh within there and so we we allowed
that quick flat flagging functionality
so this is the
in flight
populated by adobe um or data from adobe
analytics we can treat evars and and
different analytics variables as inputs
as well
we also provide the status board view
this is a very popular view where you
can manage everything
again this column is is
generated by adobe it’s it’s activities
or data collected from adobe analytics
but here you can manage your ideas your
you could prioritize idea against any of
your metadata all of your different
filters labels all that good stuff if
you wanted to look at okay show me all
the uh where ted is the product manager
so you can see all of the things across
his various states let me just clear all
the filters here
um so submitted tickets is kind of what
i said it let me let me make this a
little bit smaller there so here you can
see all of your tickets you can click on
the bottom of any of these cards it’ll
break up the bring up the side panel you
can quickly assign a developer all of
the commentary any tasks that you wish
to include within here
you can also
test managers can prioritize their
tickets as they wish which is very very
helpful
for those organizations that adopt a
journey-centric program what they’ll do
is they’ll kind of look at the different
journeys where things are going on and
kind of manage things along those lines
within there
again green means sample size has been
hit so a lot of companies will use our
status board to discuss next steps for
these ones that are green they hit their
sample size which means we have an
opportunity to get something else in its
place because we’ve got our answers that
we need here you can see some of the
alerts that are being highlighted
in the commentary as well
uh other things that are very helpful
here within the
status board is tickets that are under a
waiting summary we can click on the
bottom of the activity
the bottom of the card and we can have
all of the live activities here
to make it easy for organizations to
quickly and easily make the marriage
happen between a mia provo ticket and an
adobe target activity or data that comes
from adobe analytics
organizations can also
easily take to uh create tickets across
any of the various states within mia
provo we don’t force
organizations down a rigid um
path for example the visual editor in
adobe target makes it quick very easy to
get tests up and running
uh and if this was a test that was on
the fly it’s kind of silly to go ahead
and create a ticket under submitted
assign it to a developer and then move
that ticket you know to a waiting
summary it’s kind of kind of silly
when you can just create a ticket within
a waiting summary within here
often organizations do that
the other helpful thing that i wanted to
highlight here is the ability to copy
tickets
for example if you had a ticket if
you’re running a series of tests or you
ran an old test where all the ticket
data was filled out
you could just find that ticket within
here be able to quickly and easily copy
it
and move it to the respective state that
you wish within there that’s something
that a lot of organizations find very
very helpful um you could click on the
tickets within here uh ticket names it
brings you to
um you know the respective ticket
and the same thing goes for the
different categories you could submit
and get the shortcut to the to the
various categories um the search is
across all of the adobe metadata
including your offers your audiences
any of the code i said that’s been
included as well as any of the
organizational metadata that’s within
your tickets and so a lot of teams will
have uh this section of mia provo as
part of their you know daily stand-up or
weekly review in terms of what things
are in flight what things are coming
to help advance tickets um
through these various states to get to
the archive ticket program overview
where you can see the program impact and
all of that wonderful stuff is in place
there so any questions please hit us up
thank you for watching
This video provides a brief overview of the Library section of the MiaProva application. Here users can see all archived Activities, Program Impact against organizational Metrics, all Offers ever used, and any Insights the team wanted to store.
hello and welcome to mia prova we have a
series of videos for our users to
familiarize themselves with our user
interface videos on best practices
within miyaprova miya provis videos to
support onboarding uh as well as
case studies from some of the
organizations that are leveraging uh mia
proba this video covers our user
interface specifically the library
section of miyaproba
there’s videos available on all of these
sections this is our
library section within miyaprova
if there are any questions or topics
that would be helpful to cover please do
let us know in the comments
or email us at support meoprova.com
be sure to follow us on youtube where we
often share updates to the mia provo
application
uh helpful industry related topics and
interesting tips and tricks from adobe
target
so thank you so uh the
library section within miyaproba so it’s
available in the left navigation
throughout mia provo you can you know
suppress and make available this
navigation within here the program
overview is probably by far one of the
more popular components of our mia
profit application
all activities that are archived end up
here
and when i say uh that are archived so
tickets are
they go through the various stages
submitted under development and waiting
final summary
uh and at any point you can create a
particular ticket but um traditionally
tickets that are
uh that have recently ended or the test
is is live
those tickets will be sitting in this
awaiting final summary section so
essentially they’re literally waiting
here to have the program impact and and
the learnings apply to it so it can be
archived um so there’ll be activities
that have recently ended or activities
are still live within here uh or it’s a
ticket that’s in here that doesn’t have
an activity and so here’s how you can
manage all of this
quickly you’ve got all of the metadata
associated with the ticket you have the
adobe target data you can do the entire
activity period you have all of the
adobe data that again is journey
specific
and when we archive it mia provo creates
a permanent record of it including any
of the segments you might have apply or
any of the additional
calculated metrics that you’ve created
within here as well
all of the commentary the day-by-day
graph is is automatically captured
but here you can see a couple of
screenshots you can add in additional
screenshots uh you simply provide the
learning the takeaway from this uh and
then the location all of these are
customizable within the admin section
there i’ll spend some time on that in
the subsequent videos how you want to
classify the outcome also customizable
impact to organizations
impact to business so these are custom
metrics that will be defined as part of
onboarding mia prova uh provides street
teaching guidance on what might be
helpful program level metrics to uh map
your program against and so here’s a
drop down all of these particular
metrics
you can have additional fields all of
the fields here are customizable by your
program within mia provis a lot of
companies will incorporate things like
the voice of customer analytics hippo
like the idea source so they could
generate reports to find out what idea
sources are leading to the
most effective winners and and things
along those lines uh you can quickly and
easily send out a summary email uh with
the tests within here as well as any of
the data which is really really helpful
but what i want to highlight here is
archival so when these activities are
archived they show up in the program
overview um and so what happens is any
of the metrics that were associated with
that particular activity will be updated
within here
mia provo provides
any which way to kind of calculate those
metrics so i’ll actually kind of segue
into this
test setup section within here so you
can get a sense of what i’m talking
about so here you can see some of the
different customizations that are in
play
uh so revenue is pretty straightforward
it’s revenue and what we will do is we
will aggregate it um
with every activity that has been
archived with that particular data
but quickly for in terms of the test
metrics you can associate it with this
is more of like the macro level goals
here and these are the more the micro
goals and so let’s say revenue metrics
or engagement metrics so going to be
obviously revenue amount or percentage
but let’s say it was a percentage uh you
can it could be like a summed percentage
if you wanted to do that but
traditionally what companies will do
either average or weighted average and
one really really cool thing that mia
probably does
is if you have a test
with a 10
lift with only 500 visitors
you don’t want to be treated the same if
you have another test with a million
visitors and a ten percent lift so if
you applied average it would treat those
both the same no matter how many
visitors got into the test uh but the
weighted average if you use a for t will
automatically bring in the denominator
the visitor visit or impression or
non-a4t will bring in the same data as
well so we’ll automatically bring that
in for adobe
and so very very helpful a lot of fun
for with organizations thinking about
what type of metrics they want to
include as part of their program
overview
all the different ways to calculate the
math are there and like i said as these
activities are added we automatically
update the data here
organizations are able to quickly see
show me all of the tests that have run
on the home page and been classified
as significant loss
and marginal loss will automatically
update that data let me go to include
significant winds and marginal winds as
well
and you can see kind of the data being
updated on the fly based off of the
different things that have been added
within here so really really helpful for
organizations to see just exactly what
the program is doing
where the largest nuggets have been
found
what’s working what’s not working
and and provide a central place
for large organizations to see
the fruits of the testing team’s labor
a few other things that will be very
helpful here some feedback that we’ve
gotten from customers
is
mia prova
is a it connects to adobe and it
connects your organizational metadata
the data that’s within your tickets
and what this allows us to do is that
the way our databases are constructed is
you can search here
if if the word blue
was used in any of the code or the
offers or things like that it’s a nice
way to go and find the different things
that have been impacting this and it
doesn’t have to be the name of the
activity
um or the experiences it’s really
anything that was part of the metadata
which is really cool a lot of companies
will repurpose code and things like that
which is
very very helpful
any of the program filters
we we often
get feedback that these custom filters
that are available in mia provo programs
kind of act like variables like an
analytics workspace as you update
different values uh it’ll update the
data within here so like i said a lot of
companies are adding dimensions like
what was the idea source who’s the
product manager or analyst
or look at things by programs
me approve is all about the visibility
and one of the cool things that we do
we’re able to provide reporting to show
the distribution of testing efforts
across various teams as well as the
outcomes
and we really want to provide mechanisms
for organizations to
prophesy the learnings that are being
had
so this is the program overview aka the
knowledge library aka where all the
tickets end up
as part of onboarding a lot of companies
will do is they’ll add in historical
tests within here
mia provo has access to
all of your old activities within adobe
target so we can quickly and easily
update that
we can also update some of the metrics
after the fact we’ve got a lot of
financial organizations that don’t have
metrics
until well after the activity is run you
can
also kind of update the the the default
dating update the the the the data
within here you can download a pdf uh
a lot of our financial customers have
found this helpful for regulatory
reasons to be able to kind of keep a
permanent record of it you could also
find any of your old tests and and send
a link to it or send an email within mia
provo and you’re able to kind of quickly
access it so
again very very popular component where
everything goes to live very helpful for
companies to kind of find what metrics
are impacting things to get that
program um analysis that that a lot of
companies
need to have to scale and and to make
sure that they’re getting
much out of their optimization program
as possible uh code library i’m actually
going to jump into an account that’s
connected to the adobe database here
really quickly so you can kind of see
this
i was in a demo account here
this is mia provo on mia provost so
we’re actually using uh a live data
we’re connected to adobe io and these
are some of the demo activities that we
do and some of the different tools uh
some of the developers use to play with
but what i want to highlight here is the
code library
so
what we do is we create a permanent
record of all of the offers that were
used in any of your activities and so
here’s just quickly
uh a view of all of the different
activities the code that’s been used we
also highlight what css selectors are
there we provide some pretty nifty
reporting or alerting around that that
type of thing
for regulatory reasons this is helpful
like i said for financial organizations
i’ve had several customers thank me for
this
because they were getting alerts and tea
leaf or other various systems regarding
404 alerts
and they couldn’t find out where that’s
happening you can search here and
that’ll search across
all of the code that’s used in any of
your activities and so they were able to
search for like an
image
you know that that was being used and
they found their image
and then they can kind of see okay this
is the offer that was being used that
was that was doing it so um
really really helpful from from that
regard you can also view it by name
i’m i’m a big adobe target practitioner
i probably set up
20 to 30 activities a week within adobe
target and i’ve got several
kind of internal
notes in terms of different ways offers
that i’ve created over the years to be
helpful and so uh based off of some
feedback and just my own personal
experience with adobe target i wanted a
nice way for organ
the developers to create templates
of their uh code to make it easier you
know they could come in here and grab
like a template for them to use
for the code and they can add things as
they wish within here
code library a couple things really
quickly that we do with this data as
well is we help organizations understand
visibility into different changes oh you
can also see who the developer that
created the offer is as well
mia provo will automatically detect if
an offer has been changed in flight so
if a test is running using an offer
and someone even modifies a single
character we will let you know
we’ll also let you know if a css
selector you can see here the css
selector is no longer there or has
changed where the test is running so
that was the nifty alert that i alluded
to earlier really really really helpful
especially for those companies that use
the visual editor or custom code that
leverages the css selectors
many many pretty much all of the mi
april customers have gotten this alert
and
while there are false positives in there
there’s definitely been
quite a few uh
save the days that have happened because
of this particular alert that has taken
place so that’s the code library
lastly industry insights i’ll jump back
over to my demo account within here so
industry insights this was um
this is something that came from a lot
of our early on customers they wanted to
place a repository
where like an internet of sorts where
they can keep
internal documentation about testing as
you know the testing
industry is something that evolves quite
a bit there’s a lot of different things
out there everything from statistics to
first-party cookies third-party cookies
developer approaches server-side
client-side sdks all those type of
things
as well as you know really good tests
that have run or different
organizational rules or things like that
and so this is just a way
for organizations to contribute content
uh and have it associated easy for here
we provide
a little bit of some you know
data kind of like adobe recommendations
where you see the most read
obviously full search um and then the
ones that are recently added so it’s a
helpful way for people to get access to
different things i i do have a video
planned um several of our customers put
in some really cool stuff uh in terms of
uh links to different things so i want
to kind of highlight the most what i
think to be the most helpful things and
you can see a couple of the different uh
you know things to link to within um
this demo account that i’ve been found
helpful so that’s the library section
of mia croba as always any questions any
other kind of deeper dives in any of
this please let us know in the comments
or hit us up at supported email.com
thank you so much
