Pilot planning

Success Criteria Before Day One: Three Measures per Pilot

 By the GLOBAL MUSIC PARTNERSHIP editorial team / Supervised by Naoto Tanaka (Tarnar sensei)

A pilot is easy to judge when you decide what success means before it begins. Here is how to pick three simple measures for each of the four common pilot shapes.

The best moment to decide what success looks like for a pilot with a partner in Japan is before the first day of work. Choose about three measures, write them in one short note, share the note with your partner, and the final review turns into a friendly comparison between what you hoped for and what happened. This guide shows how to choose the measures and gives worked examples for the four pilot shapes most teams begin with.

The partnership window at global-music-partnership.jp begins with a small, time-limited pilot that has one goal. Typical examples are a co-written song, a single online workshop, one joint performance or a limited-time online release. Before the pilot starts, both sides agree on the goal, the roles, the deadline and the way they will look back. Success criteria are the missing piece that connects the goal to the look back.

Why decide before, not after

When criteria are chosen after a project, people tend to remember the parts that went well and to explain away the parts that did not. When they are chosen before, the conversation is fair. Both sides know what they are aiming at, and a stop or a change of shape can be discussed without blame. The window treats a decision to end or reshape a pilot as a valuable result in its own right, because it frees time and money for something that fits better.

Deciding early also helps with communication across two languages. A short written note such as "success means these three things" is clear in English or Japanese and can be translated easily if a colleague needs it.

The menu of four measures

The window suggests keeping the number of criteria to about three. You can pick from this menu of four kinds of measure.

MeasureThe question it answersTypical evidence
Quality of the workAre we proud of what we made?A finished song, a recorded class, a performance that went to plan
Ease of workingWas it easy to collaborate?Clear roles, replies on time, few misunderstandings
Listener or learner responseDid the audience feel something?Comments, messages, a lively room, students asking for more
Cost and timeWas the effort in proportion to the result?Hours and money recorded against what you expected

Most pilots do well with one measure about the work, one about the experience of collaborating, and either listener response or cost and time. Choose the combination that matters most to the person who must say yes inside your organisation.

Worked examples for four pilot shapes

One co-written song

The goal is a finished song by teams from two countries. Three measures might be: the song reaches a demo with a sung vocal; every member of both teams can name their own contribution; and the team spends no more hours than the plan says. If you join a co-writing camp in Atami, the schedule already ends with a demo vocal on the last morning, so the first measure fits naturally.

One online class or workshop

The goal is a class that students in your country attend with a teacher in Japan. Vocal lessons for overseas students are given online, with the time zone adjusted. Three measures might be: the class starts and ends on time for both sides; students say what they learned in one sentence each; and at least some of them ask to join again.

One joint showcase or exchange performance

The goal is a single shared event. Three measures might be: every performer on the programme has a clear slot; the technical check is finished before the day; and the audience stays until the final song. A whole-room song at the end is a gentle way to see the audience response with your own eyes.

A limited-time online release

The goal is to publish a piece of work online for a set period. Three measures might be: the release goes live on the planned date in both countries; listeners leave comments in either language; and the team records how many hours the release took.

Turning a measure into something you can check

A measure is only useful if it can be checked. Take each one through three small steps.

  1. Say it in one sentence. "The song reaches a demo vocal."
  2. Name the evidence. "We will have an audio file with a sung vocal."
  3. Name the person. "The lead on each side confirms it."

Measures that cannot pass these steps are usually too vague, such as "a good atmosphere". If a feeling matters, turn it into something visible: "each person gives one sentence about how it felt to work with the partner."

What to record while the pilot runs

You will not remember details at the end, so a simple record helps. The window suggests tracking the number of exchanges between the two sides, the time and money spent, and the problems and successes that appear. A single shared page is enough.

ItemHow to record it
ExchangesA tally of calls and messages each week
TimeHours per person, noted at the end of each session
CostEach payment and the reason for it
ProblemsA line each, with the date and what fixed it
SuccessesA line each, because wins teach as much as problems

Recording the wins is just as useful as recording the problems. When you write the final report for your management, the list of wins gives the report its energy and its evidence.

Using the criteria at the review

When the pilot ends, the window suggests this order: compare the results with the goal, look back together with the partner, decide the next adjustment, and then continue, change the form or finish. With criteria already written, the first step is a simple table.

MeasureAimed forWhat happenedMet?
QualityDemo with sung vocalDemo finished on the last morningYes
EaseEveryone names a contributionMost could, two were unsurePartly
TimeWithin planned hoursSlightly over in week twoPartly

The example above is only an illustration of the layout. Fill in your own results honestly. A "partly" is a gift, because it shows exactly where the next adjustment belongs: perhaps clearer roles, or a plan with more time in the second week. Share the table with your partner before the review meeting so that both sides arrive with the same facts.

A one-page note you can copy

Put the agreed criteria on a single page and send it to your partner before the work begins. A simple layout is enough, and it can be written in plain English so that translation is easy.

HeadingWhat to write
GoalOne sentence, for example "one song written by both teams"
DatesStart day, end day and the day of the review meeting
LeadsOne name on each side
Three measuresEach with its evidence and the person who confirms it
RecordsWhere the shared page lives and who updates it
After the pilotThe three options: continue, adjust or finish

Ask your partner to add anything that matters on their side. A school may care most about student response, a label about the quality of the master, and a festival about how smoothly the stage day runs. Writing these differences on one page early prevents surprises at the review and often reveals that the two sides want complementary things, which is an excellent sign for the partnership.

Common questions

Can the criteria change during the pilot? Yes, if both sides agree and write the change down. Change them only for a good reason, such as a new date, and not because a measure looks hard to reach.

What if we have no concrete plan yet? The window can help you sort a goal from the works and materials you already have. A goal first, then three measures, is a good order.

How strict should the numbers be? Use numbers where they come naturally, such as hours or the date of release, and short sentences where they do not. A pilot is small by design, so the aim is learning, and a measure that is missed by a little is information, not failure.

Who decides the measures? Both leads, together. Proposing a first draft yourself is helpful, since it gives your partner something to react to.

When you are ready to plan your own pilot, send your company name, country, time zone, goal and preferred language through the contact form or LINE, in English or Japanese. Begin at global-music-partnership.jp.