Theatre Australia

your portal for australian theatre

Adjudicators, Bias and Criticism

Sat, 31 Jan 2004, 12:52 pm
Greg Ross9 posts in thread

After reading Ron Banks critique of Mike AnthonyÂ’s play in The West Australian (Saturday 31 January), I wondered how some of those who have expressed their anger about adjudication processes in recent weeks, would react to a similar methodical analysis. I suspect not well, for what appears to annoy the most, is the perception of personal bias. And yet, bias will always play a part in the judgment of any work in the arts.

I’m one of those bored to tears by the whole Irish thing, yet I consider Mike Anthony a good bloke and very talented. I also thoroughly enjoy time-out with the vampire books of Anne Rice, but literature critics don’t even bother to review them. I went to see “Japanese Story” in Kings Park last night. It was the second time I’d seen the film, as I like it so much. However, half a dozen people around me, loathed it and regretted coming.

WhoÂ’s right and who is wrong?

This leads to the arguments of those who would declare one set of theatre skills far more important than the other, which indirectly makes me smile, remembering an old joke about which was more important – the brain or the anus.

I am sure everyone is aware of the term “beautifully crafted.” To me, that phrase sums up the essence of an award winning play, musical, or film. There may be technical mistakes, there may be actors less skilled than others, however, the overall production is so good (how important does that make the director and technical crew?), that the production is clearly worthy of award. It will be interesting to watch how “Lord of the Rings” fares in the Oscars.

It is human nature to need acknowledgment and encouragement from families and peers, it’s vital to our psyche and our emotional growth. It’s also essential to learn from and understand our mistakes and perhaps just as important, to see things from another’s point of view – walk a mile in their shoes. Of course, criticism must always be given with the intention of helping someone to improve.

Where then for the process of adjudication? Some have asked for access to adjudication meetings and notes, but for what purpose? Although the adjudication process involves critiques of productions, the end-design of an award system is not the release and discussion of individual judgements of a production, rather the sum of judgements of a selection of productions.

It would appear, that with the very best of intentions, the Finley Award system has accidentally become unwieldy, in terms of sheer numbers of adjudicators and their ability (in the fullest sense of the word), to properly review every production. As more and more theatre groups seek sponsorship money and in consideration of the many people in community theatre who desperately wish to become professionals, itÂ’s obvious that the adjudication system must become more professional.

There is, for instance, no place for someone like myself seeking to adjudicate musicals, I’m biased, I don’t like them. Come to think of it, there’s no place for me adjudicating anything – I don’t have the expertise. However, there is equally, no place for an adjudicator who “only does musicals,” or falls asleep half way through a production. It would seem obvious that the adjudicator system needs revamping to be based on a group of people, with a well rounded, balanced and experienced understanding of theatre and the various crafts within.

Possibly this would entail a core group of four adjudicators, with two or three reserves. The adjudicators would be required to see all entered productions, (not necessarily together), with a reserve taking someoneÂ’s place in case of illness etc. Naturally an adjudicator would not be able to produce or direct a play entered for the FinleyÂ’s during their term of adjudication and would have to declare any interest in a particular club / production and step down from adjudicating that particular event. Equally, if a club kicks up a fuss about giving tickets to the adjudicators, they simply arenÂ’t adjudicated.

Of course, as with any organisation, there are always those frightened of change, or unwilling to lose control, not to mention the fear of that tap on the shoulder. So whilst the necessary changes may not be instantly achieved, they will happen. There are some very experienced, thoughtful and determined people currently serving as adjudicators, ITA committee members and interested theatre people, who have been and are putting enormous effort into bringing about the changes people are rightly clamouring for. IÂ’m prepared to bet that the accolades for next years Finley Awards will have the ITA Committee members in tears of joy.
Cheers
Greg Ross

NB: These are my private thoughts and are in no way meant to represent those of other ITA committee members.

Re: Adjudication multiplication

Mon, 2 Feb 2004, 11:49 pm
Grant Malcolm wrote:
>
> How does the number of adjudicators adversely impact on the
> quality of the results obtained? I fail to see why a process
> that adequately involves a dozen people shouldn't return as
> satisfactory, if not more satisfactory, results than one with
> only four or so.


I think I tend to agree. For the purpose of example, let's exaggerate and allocate 100 people to be adjudicators for the year.
Assume that they all have some reasonable credentials and are probably keen theatre goers, possibly affiliated with a local club.

Allow for the rule that nobody can pass judgment on a show or a club they have personally been involved in.
(Do we really believe that if someone has been involved in a production, their bias is so great that they will automatically mark everybody else's production poorly? My tendency would be to allow a theatre practitioner to make observations and judgments concerning anyone else but their own shows...but I don't fully understand the politics and competitiveness behind these awards; perhaps some of the most suitable and experienced observers are going to be lost from the ranks of adjudicators, because of a perceived conflict of interest?)

We maybe now have 60 adjudicators who are eligible to assess every show.

Allow also for an attrition rate...it's just not possible for EVERYBODY to see EVERYTHING....
We maybe now have 20 who HAVE seen everything, but another 30 who have seen a great deal and are qualified to make comparative judgments.

Don't discount those who have fallen by the wayside because of only seeing two or three shows...those 50-odd can still submit reasonable criticism of the shows they DID see.

Out of the original 100 we have 20 who have attained 'seniority', meaning simply that they've seen everything. Their votes carry more weight. But on a sliding scale, we still have the other 80 who can contribute to the discussion in some way or another.

The marks are collated and averaged, and popular choices become apparent. Discrepancies that arise, from perceptions about the way marks were allocated, are made visible to the whole group, to discuss, justify, and modify if necessary, until a reasonable conclusion is formed.
This would include adjudicators with a 'specialist' interest, say Broadway musicals, or Elizabethan tragedies, being able to have a degree of influence over the marks allocated to a particular style of play, noting whether or not various aspects were executed well.

There would be the inevitable impossibility of getting everyone to agree, but with the influence of those with 'seniority', and the logical sense of 'majority rule', I reckon you'd get pretty close to having results that were generally agreed upon.



My figure of 100 people was pulled out of the air for convenience, and my smaller figures are not meant to represent any sort of accurate percentage breakdown, merely a plausible scenario.

But I think I'd have more confidence, and less inclination to complain about the results, with a larger number rather than if there was a gang of four responsible for all the decisions. This includes happily allowing for the fact that not all the judges saw my play, or have any particular interest in my style of hybrid-cross-platform-politically-based-group-devised-artaudian-tragi-comic-spoken-poem-underwater theatre....or the few that I KNOW don't like me because I criticised their poor spelling...



Cheers,
Craig

Thread (9 posts)

← Back to Billboard Bulletins