Pilot review
Continue, Adjust or End: The Review Meeting After a Pilot
When a small pilot is over, the review meeting decides what happens next. This guide gives you the agenda, a scoring sheet and three clear outcomes.
After a small pilot with a partner in Japan, hold one review meeting and finish it with one of three decisions: continue, adjust the format, or end the project. Start by comparing your goals with the actual results, review them with your partner, settle the adjustments for the next round, and then choose. The GLOBAL MUSIC PARTNERSHIP desk states that deciding to stop is also a valuable result, because the lessons from a short pilot inform the next one. This guide gives you an agenda for the meeting, a scoring sheet you can bring and a plan for each of the three outcomes.
Before the meeting: collect what you recorded
A review is easiest when notes were kept during the pilot. The desk suggests recording three things as you go: the number of exchanges, the time and cost spent, and the problems and successes you met. If you did not keep a log, rebuild it in an hour from your email, calendar and chat history. Put the facts on one page, since the meeting should spend its time on decisions, not on searching for dates.
| Record | Where to find it |
|---|---|
| Number of exchanges | Email threads, meeting invitations, messages in your shared chat |
| Time spent | Calendar entries and a rough count of preparation hours on each side |
| Cost | The written proposal and any extra items agreed along the way |
| Problems | Notes from weekly updates, and any message that began with "we need to fix" |
| Successes | The finished work, audience comments and moments the team was proud of |
Ask your partner to prepare the same page from their side. Two pages side by side show you quickly where your pictures differ.
The scoring sheet: three points, not thirty
The desk recommends narrowing success criteria to about three points. Typical areas are the quality of the work, how easy it was to produce, the response of the audience, and the cost and time involved. Choose three before the pilot starts, and use only those three at the review. A short list keeps the conversation fair and calm.
| Criterion | The goal we wrote | What happened | Score from 1 to 5 |
|---|---|---|---|
| Quality of the work | |||
| Ease of production | |||
| Response of the audience |
Fill the sheet in separately on each side, then compare. A difference of two points or more on any line is a good topic for the meeting, because it shows that the two teams experienced the pilot differently.
A 45-minute agenda
Use a simple order. The desk's decision steps run in this sequence: compare goals with outcomes, meet with the partner to review, settle on adjustments, then choose to proceed, change the format or end the project.
- Welcome and purpose (3 minutes). Say what the meeting will decide.
- Goals and results (12 minutes). Walk through the scoring sheet one line at a time.
- What went well (8 minutes). Each side names two things that worked and thanks the other for one of them.
- What to change (10 minutes). List problems and agree an adjustment for each one that you want to carry forward.
- The decision (8 minutes). Choose continue, adjust or end, and record the reason.
- Next steps (4 minutes). Name who writes the recap and by when.
The meeting works in English or Japanese, which are the two languages the desk uses. If part of your team prefers Japanese, ask the partner to share the agenda in advance so that everyone can prepare.
Reading mixed scores
Scores rarely come out even. Use the pattern below to turn a mixed sheet into a decision.
| Pattern | What it usually suggests |
|---|---|
| High on quality, low on ease | The idea is strong; adjust the process, the schedule or the tools |
| High on ease, low on audience response | The teams work well together; adjust the format or the audience |
| High on audience, low on cost and time | The result is promising; reduce the scope before the next round |
| Low on all three | Consider ending kindly, and note what each side learned |
| High on all three | Prepare to continue and begin the agreement conversation |
An illustration (an example, not a real case)
Imagine a school that tried one online class with a teacher in Japan. The class scored 4 on quality and 2 on ease, because the lesson started very early in the morning for the Japan side. The audience score was 4. The review team would see that the idea works, and the adjustment is clear: move the class to a time that suits both time zones and keep everything else the same. The decision is to adjust, and the next pilot has a single change to test. This is how a review turns a small problem into a clear next step without discarding what worked.
Questions to ask when the two sheets disagree
- Did we write the same goal in the same words at the start?
- Which part of the work did only one side see?
- What did each side expect from the other that did not happen?
- If we repeated the pilot next month, what is the single change we would both make?
These questions keep the discussion about the project and not about the people. Answer them in turn, write the replies down and let the answers shape the adjustment list.
Outcome one: continue
If the scores meet your goals and both sides want more, move to a larger step. The desk's fifth step is an agreement and launch, in which conditions are confirmed and signed before scaling up. Before you ask for that, write down what will be different in the next round:
- A new goal, still limited to one clear aim.
- The roles on each side, including any new people.
- The dates, with enough time for preparation.
- The rights holder and scope for each work involved, to be recorded in the contract.
- The cost and payment schedule in a written proposal.
The desk confirms terms, fees, schedules and rights case by case before any agreement, so allow time for that conversation and keep the first pilot's log as a reference.
Outcome two: adjust the format
Sometimes the pilot shows that the idea is right but the format is not. A co-writing session may have worked well except that the time zones made the calls tiring. An online workshop may have needed a longer break. Adjusting is a positive result, because the two teams now know which part to change.
| What you noticed | An adjustment to try |
|---|---|
| Calls were too long or too early | Shorter meetings at a time that suits both time zones |
| The goal was too wide | Cut it to one clear aim and drop the rest |
| The audience response was low | Change the format, for example from a single performance to an online workshop |
| The cost was higher than expected | Reduce the scope and ask for a revised written proposal |
The desk lists four small formats to start with: co-producing one track, a single exchange performance, an online workshop and a limited online release. If the first format did not fit, one of the other three may suit your goal better.
Outcome three: end the project kindly
Ending is a legitimate decision, and the desk treats it as a valuable result. A pilot costs little compared with a full project, which is exactly why it exists. If the scores or the conversation show that the match is not right, say so with thanks.
A short closing message works well. Thank your partner for their time, name two things you learned, confirm that no further work is expected and say that you would be glad to talk again if circumstances change. Keep the final files and the log in a shared folder so that both sides can look back at them. Because ending is a decision made in the open, it leaves the door unlocked for a future project.
After the meeting: write the recap
Share the recap with the people who supported the pilot from the outside, such as a manager, a head teacher or a festival board. They gave you time and trust, and a clear summary of the decision, with the scores and the reasons, shows them how the money and hours were used.
Within a day, send a short recap that contains the decision, the reason, the next steps and the date of the next contact. Add the scoring sheet as an attachment. A written record is helpful for colleagues who were not on the call, and it keeps the project from drifting.
If you are planning your first pilot and want to set up the review from the start, tell the desk at the first message. After the first online meeting, a written proposal arrives with the cost and payment schedule for the pilot, and no fixed prices are published. Contact the GLOBAL MUSIC PARTNERSHIP desk to begin.
FAQ
How many success criteria should a pilot have?
About three. Typical areas are the quality of the work, ease of production, audience response, and cost and time.
What should we record during a pilot?
The number of exchanges, the time and cost spent, and the problems and successes you met.
Is it acceptable to end a pilot?
Yes. The desk describes deciding to stop as a valuable result, and the lessons inform the next pilot.