Different Ways Of Measuring Impact

by:

Joe Patti

I am always keeping an eye open for different ways arts organizations can employ meaningful measures of impact. AEA Consulting listed different impact evaluation tools and criteria being used around the world. Most of them are in relation to social impact, but a couple, like Social Return on Investment (SROI) tied to economic measures such as dollars worth of social impact for dollars invested.

Others are not tied to a currency valuation.

Participatory and rights-based models, prominent in Latin America, frame impact around cultural rights, community capacity, and social transformation. Examples include cultural impact assessments with Indigenous communities and long-running community arts networks in contexts such as Colombia and Brazil, where impact is assessed through measures such as social cohesion, leadership, and cultural citizenship rather than financial returns.

Local community-focused models, e.g. frameworks such as Singapore’s Neighbourhood Arts and Culture Impact Assessment (NACIA) link arts participation to neighbourhood attachment and social networks, combining spatial indicators with health and wellbeing measures.

In terms of how data is collected, AEA lists a number of modes including

Qualitative Tools….audience and participant surveys, validated health and wellbeing scales, social capital measures, and composite indices that track neighbourhood vitality, diversity of participation, or organisational reach…

Qualitative and participatory methods… focus groups, case studies, observation, and creative techniques (e.g. visual brainstorming, storytelling) are used to capture changes in confidence, identity, and agency. These approaches are particularly important for smaller non-profit organisations, which may lack the resources to implement SROI or large-scale experimental designs.

AEA said some of the commonalities they see in these approaches are focus on outcomes rather than outputs, mixing both quantitative indicators and qualitative evidence, and paying attention to who is participating and benefiting.

Long time readers know I have frequently employed a mantra that just because you can measure it, doesn’t mean the results are meaningful. While some of these methods and measures are interesting to me, there isn’t enough detail provided for me to determine if they result in data that is relevant and meaningful.

Cultural Sector Re-Sorting Rather Than In Retreat

by:

Joe Patti

Colleen Dilenschneider and the folks at IMPACTS Experience have been dependable as always and recently provided a market outlook for arts and cultural organizations for 2026 & 2027 based on what research is telling them. (subscription required)

Two of the big general takeaways for me was: First- Use 2019 attendance as a reference point, rather than something you are striving to get back to. The operating environment has changed.

And Second:

 The data does not show a sector in retreat, but a sector re-sorting.

The most important macro insight for the visitor serving sector is in 2026 and 2027 is that demand is not collapsing; it’s fragmenting along structural lines. The organizations that are doing well are growing stronger, and the organizations that have been struggling are generally facing increasing and compounding challenges.

While the data shows certain disciplines will see modest to marginal improvements (zoo, aquariums, gardens, history museums/sites, live theater) and others will remain flat or see a small improvement in engagement (children museum, natural history museums, science centers, symphonies, opera, ballet.), they warn readers not to interpret that as a set destiny. These are general indications. Every individual organization is different.

They talk about the self-reinforcing death spiral that can occur when organizations cut back on capacity because they don’t have visitation. Among the things they encourage organizations to do is trying to maintain that capacity.

Additionally, they repeat the importance of findings released over the last year which I have covered. Including reducing the friction of finding information and purchasing admissions.

The fact many visitors appreciate value added experiences rather than discounted ones.

They note that while international travel is down, domestic travel to cultural destinations remains robust. However, you may recall that last month, they qualified this noting people are trying to squeeze their experiences into fewer days and cultural organizations need to have a plan to meet those needs.

Permission To Be Creative

by:

Joe Patti

h/t to Anne Smith who posted this video on Linkedin of Ethan Hawke talking about giving yourself permission to be creative.

For me the big impactful statement he makes is that everyone thinks arts and creativity don’t matter until they encounter a moment of great sorrow or joy and need to get their bearings. Suddenly, they wonder if their experience is unique in the world or if others have gone through the same thing.

So you have to ask yourself: Do you think human creativity matters? Well, hmm. Most people don’t spend a lot of time thinking about poetry. Right? They have a life to live, and they’re not really that concerned with Allen Ginsberg’s poems or anybody’s poems, until their father dies, they go to a funeral, you lose a child, somebody breaks your heart, they don’t love you anymore, and all of a sudden, you’re desperate for making sense out of this life, and, “Has anybody ever felt this bad before? How did they come out of this cloud?”

Or the inverse — something great. You meet somebody and your heart explodes. You love them so much, you can’t even see straight. You know, you’re dizzy. “Did anybody feel like this before? What is happening to me?” And that’s when art’s not a luxury, it’s actually sustenance. We need it.

One of the big challenges for those of us that operate in the artistic and creative space is to convince people that creative experiences aren’t just for those moments of overwhelming joy or sorrow, but can be part of your everyday expressive life. Especially, as Hawke says, if you are willing to appear a little foolish.

AI Coming For ESPN Commentators

by:

Joe Patti

There’s a kinda meme image circulating where a person says they had imagined a future where AI made her work easier so that she had more time for creative leisure. Instead, AI is being used to generate creative work.

The unspoken conclusion is that the woman continues to be stuck working hard.

Additionally there is an increasing skepticism about any sort of creative work being the result of the artist. I was watching artists presenting proposals for public art installations in the last two weeks and each made very specific disclaimers about what in their presentations was AI generated. (Largely, it was the streetscapes in which the proposed art work was positioned.)

Economist Tyler Cowen recently posted a job listing which was paying people with sports expertise pretty well to evaluate AI tools analysis of basketball games. As a number of commenters noted, people would essentially be training their replacements.

Since I have already seen an AI translate foreign language into English from video and match the energy of the speaker, I imagine it won’t be long before AI is doing analysis and color sports commentary in real time, drawing from existing reporting about injuries and career history.

I guess there is potential for these tools to be applied to reviews of performances and lead to a return of arts coverage. Though I imagine that would be a lot tougher to identify the nuances in technique and tempo in dance and music those fans want vs. analysis of a basketball game. One obvious concern in addition to this tool replacing human writers is AI reviewing work created by AI.

Here is the job description Cowen posted.

Role Overview
We’re looking for Basketball experts — avid fans, sports journalists, commentators, and former or semi-professional players — to evaluate basketball games. You’ll watch basketball games and answer questions in real time assessing the quality, depth, and accuracy of AI insights, helping us refine our AI’s basketball reasoning, storytelling, and strategic understanding.

Key Responsibilities
Game Evaluation: Watch basketball games and review AI-generated play-by-play commentary and post-game analysis.

Performance Scoring: Rate the accuracy, insight, and entertainment value of AI sports coverage.

Context & Understanding: Assess the AI’s grasp of player performance, game flow, and strategic decisions.

Error Detection: Identify factual mistakes, poor interpretations, or stylistic inconsistencies.

Feedback Reporting: Provide clear written feedback highlighting strengths, weaknesses, and improvement opportunities.

Collaboration: Work with analysts and developers to enhance the AI’s basketball-specific reasoning and realism.

123792 Next