Posted by Richard Whittall under Soccer Analytics on Jun 18, 2013
Yesterday there was a brief bit of Twitter drama over a hockey analyst who deleted an archived post because it included a prediction about the surefire future failure of a particular goaltender, one that later proved to be false.
Before we get into this discussion in a soccer analytics context, anyone who lends their by-line to a published opinion about sports runs the risk of being wrong from time to time (or a lot if they’re not very good). There are a number of ways a writer can address their past mistakes. Here are four:
1. Ingore them. Simply pretend you never wrote the article in question that asserted Andre Villas-Boas career at Spurs would end in tears before the season’s finish as the club faces relegation. If you write for an old-timey newspaper hidden behind a pay-wall, this is much easier to do. If your work appears on-line, you’ll just have to tough it out for a while as commenters call into question your authority to speak on any sporting subject because, you know, you were wrong once.
2. Admit you made a mistake in your prediction, but reverse engineer several mitigating circumstances that determined the eventual outcome. Perhaps in your original article on AVB, you assumed the club wouldn’t have had the transfer budget it in August, or that a particular player would stay instead of leave. You’ll take the hit perhaps for not taking these factors into consideration in the first place, but you can at least salvage the illusion that you’re somehow never flat out wrong on occasion.
3. Delete previous instances in which you were wrong. In the digital age, why bother with accountability? Chances are no one will notice if you erase that pesky AVB prediction from a few months back. Your precious “expertise” remains intact, at least until someone catches you in the act, in which all of your credibility goes down the toilet, possibly forever.
4. Embrace your mistakes. Look to see where your prediction failed, and publicly discuss possible reasons why. Don’t be afraid to pose questions rather than pound out an entirely new set of answers. Use your prediction error as an opportunity to further refine your approach, to learn something new about the sport about which you thought you knew everything.
These options, you’ll note aren’t simply available to all sports writers across the board. Some analysts write in such a way as to make the fourth option impossible. This is the writer who stakes their entire career on being a capital ‘E’ expert. They work to convince their readers that they are where they are (and are paid what they’re paid) because their opinions on sports are invaluable, better than the myriad opinions of others. They’ll argue they either have a level of education or experience in the game that sets them apart.
The sportswriter-as-infallible-expert model worked well in the age of newspapers, a time when there was little accountability for the sports opinion writer beyond the angry glare of an editor or editors, in addition to tremendous pressure to shore up bona fides to the public to answer the implied question that dogs all staff writers in a competitive field: “Why this guy and not someone else?”
The newspaper format didn’t help either. Daily single edition publications received through paid subscriptions aren’t exactly amenable to expressions of doubt or uncertainty, let alone regular follow-ups on a single topic, collaborative projects with several writers, or long-winded discussions within a frequently updated comments section.
In the age of papers, most readers would likely forget whatever a columnist predicted about something by the time the results came in to hold them accountable. There were no easily searchable newspaper archives, let alone a section in which a reader could gripe without having to write a letter in the hopes a kind editor would publish the dissent a day or days after the fact. While some writers established their writerly authoriteh with gorgeous prose, others shored up their credibility with the strength of their convictions.
The writing style of sports “expertism” has certainly carried over to the digital age, but today the writer can no longer post what they like and then hide behind the walls of their publication. Writers are now hounded continuously on comment pages or on Twitter by readers looking for ways to show them just how wrong they are. Often these confrontations devolve into name-calling or references to comparative numbers of ‘followers,’ but increasingly a fair number of sports columnists regularly engage in lively conversation with readers and other writers, which certainly isn’t a bad thing.
It’s about here where readers of this column are wondering where the bit about analytics comes in.
One the major criticisms of soccer analytics right now is the sense that analysts believe they know something the rest of the football-loving public doesn’t. Not only that, but this knowledge sets them high above the great unwashed football fan. In other words, they’re simply a newer brand of sports expert whose grasp of statistical science provides a shield from criticism.
Andi Thomas spoke to this a little in his lip-smackingly good review of Chris Anderson & David Sally’s new book, The Numbers Game:
From the ordinary fan point of view, the wider question is more-or-less moot: if you like systems, and analysis, and figuring out how things works, then this book will fit neatly into the burgeoning library of online and offline writings, and you’ll enjoy it. If you don’t, then you can safely ignore it without missing too much. As illuminating as much of this is, anybody nursing the idea that greater acceptance of analytics into the mainstream will put an end to people saying and believing incorrect things about football is being naive. Perhaps a few cliches will die a death, perhaps one or two columnists will set aside some established truths, but the broad sweep of footballing chitter-chat will retain its fundamental character, and be defined by plenty more than just the vitally-important-yet-terribly-reductive question of who is and isn’t any good.
I haven’t yet read the book, so I can’t speak to Thomas’ specific criticisms. But I think his point about tempering some of the more evangelical fire of analytics-thumpers (like yours truly) is a good one, if perhaps a little misguided.
I’m not sure that most analysts, amateur or otherwise, care as much about receiving widespread public ‘acceptance’ from those who otherwise don’t give a toss as they do in countering a few angry critics who claim, repeatedly and with no convincing evidence, that soccer analytics is simply a waste of time.
There are of course several hills on which soccer analysts would readily die, particularly those that involve warning against extrapolating general claims from single, ninety minute games. Thomas of course right in asserting that these dissenting voices on conventional football punditry aren’t limited to the PDO set. There is an entire cottage industry of angry young men and women who continue to shake their fist at lazy cliches and from-on-high footballing opinions shored up with grandiose self-regard (Joe Kinnear) and abusive shouting (Joe Kinnear). They don’t need a spreadsheet to know that Lawro’s predictions are wrong all the time.
The problem is this set has been ranting and railing against the BBC and Lawro and all the rest for decades now, stretching all the way back to the first issue of When Saturday Comes and even before that, to no avail. Football discourse has been locked in thesis/anti-thesis with no end in sight.
Perhaps everyone involved prefers it this way. Just as the fan will use his own eyes and ears to give his or her opinion on the general worth of Charlie Adam to anyone who will listen because it’s fun to talk about football, so too might the iconoclast football writer enjoy using a torrent of sarcasm in alternative publications/websites to demolish the tired cliches of Motson, Lineker and the rest because it’s fun to write angry.
I think the analytics community (at least the one I’m aware of) isn’t really in on the joke. They take football’s questions seriously (in so far as they think they’re worth exploring), and believe there may be answers beyond the subjective ravings of some guy in the paper. And, as with anyone looking to earnestly find an answer, they tend to begin by admitting their uncertainty, in first finding the right questions before rushing headlong into an answer.
In fact, good analytics trades in doubt. Few analysts of any worth that I know of would go to the wall for their predictive models; many of the best analysts view errors as a godsend, a means to make adjustments, learn more, collaborate more, improve. Errors are part of a process, rather than dents in credibility.
Yesterday I read Malcolm Gladwell’s review of Jeremy Alderman’s book on the extraordinary economist Albert O. Hirschman. Gladwell quotes a passage from the book on Hirschman’s mentor and friend Eugenio Colorni that nearly got me out of my bed, fist pumping to the ceiling.
Colorni believed that doubt was creative because it allowed for alternative ways to see the world, and seeing alternatives could steer people out of intractable circles and self-feeding despondency. Doubt, in fact, could motivate: freedom from ideological constraints opened up political strategies, and accepting the limits of what one could know liberated agents from their dependence on the belief that one had to know everything before acting, that conviction was a precondition for action.
Doubt, uncertainty, awareness of the limits of knowledge and acceptance failure are not the dead ends that the sports experts once stridently believed them to be, but often the seeds necessary to grow beyond the simple binary of thesis/anti-thesis and into synthesis.
To those within and without, the current analytics community has often resembled a classic internet circle-jerk. Yet a closer look shows a lot of consensus on some issues with rough dissent on others, almost always expressed publicly and without reservation. “Your sample size is much too small to reach that conclusion.” “There isn’t enough evidence to make that kind of claim.” “The shots on target data collected here isn’t very reliable,” etc. etc. In my limited experience, these criticisms lead to amendments, follow-up posts, corrections, and no doubt some hurt pride. But everyone knows that the public nature of football analytics writing prevents anyone from trudging out into the public realm making absolute claims without the benefit of solid evidence. An analyst is only as good as their process, not the stridency of their claims that they’re right.
Some writers perceive the skepticism of the analytics community over whether there are such things as good finishers or scoring streaks as a dig or an insult, a smug assertion of some greater knowledge of the game bestowed by a specialized science. And indeed, many analytics writers no doubt take great pleasure from exploding the “scoreboard journalism” that has dominated soccer writing for so long. But I don’t know of any who would claim that knowledge of analytics is a precursor to enjoyment of football (as daft a claim as anyone could make). Analytics writers are just as harsh on each other or themselves as they are on the self-proclaimed experts. They just don’t want to accept lazy-half truths about soccer just because it’s a game and all in good fun. Nor is the latter an adequate reason not to peel back its layers, to learn what makes it tick, to find new ways to enjoy the beautiful simplicity of the simplest game.
Posted by Trey Kerby under Miami Heat on Jun 18, 2013
We all make mistakes, you guys. For instance, once upon a time, I predicted the Houston Rockets would be the league’s worst team during this year’s regular season. Yeah, they hadn’t yet traded for James Harden, but still a big-time whoops.
However, making mistakes isn’t always bad. Not only can you learn some valuable life lessons, you might also inspire someone to make you look like an idiot. That’s what happened with Ray Allen and SLAM magazine a million years ago. From SLAM:
“I’ve had one gripe my whole career about SLAM and I still keep it ‘til this day. It’s probably one of my sole motivators on a daily basis and I don’t know if I ever told anybody this. When that article came out with all of us on the cover [of SLAM 15], it had the (predicted) accolades on the inside. It said most likely to win MVP, most likely to do this. One of them said most likely to fade into obscurity…..and it was me. I was 21 and I knew what obscurity meant, but I had to look it up because I needed to make sure. It pissed me off because I felt I was going to leave my mark on this league. Whoever wrote that pissed me off and it gave me motivation my whole career. I was like I want to be somebody who I’m going to leave my lasting mark on this league. As much as it pissed me off, it was a good thing because it always made me remember that there were people who thought I wasn’t going to be good. So that was motivation.
Just to clarify, the cover Ray is talking about is the one that features the famed 1996 draft class. Essentially, that means that SLAM picked Ray Allen — a future Hall of Famer who has made the most threes in NBA history, has an NBA title and went to 10 All-Star Games — as the draftee Most Likely to Fade in to Obscurity instead of guys like Erick Dampier, Todd Fuller and Samaki Walker. Even Shareef Abdur-Rahim, that year’s third overall pick, did more fading away than Ray Allen did, unless we are talking that corner three Ray always takes where he’s falling to his left but still shoots straight somehow.
I also very much like that Ray Allen knows what “obscurity” means but still decided to look up the definition so that he could be properly motivated. You can always count on my good friends, Merriam and Webster, to come through in the clutch.
Posted by Justin Bourne under Bourne's Takeaways on Jun 18, 2013
I already started this post once, but “I disagree with Jonathan Toews’ usage last night” ended up being 600 words and its own post, so let’s try this again.
1. Life for Chicago after Hossa: not hopeless, but awfully bleak
After the game we found out Joel Quenneville knew there was some chance Marian Hossa may take warm-up and call it a day as he did, which makes it awfully bizarre that Ben Smith didn’t warm-up and Jamaal Mayers did, despite the former playing and the latter not. But anyway.
When Hossa’s out it tips the balance of the series to Boston with a reasonably heavy weight. Bold, I know. But he really is one of the league’s best puck possession players (and I mean actual ability to maintain possession, not Corsi), a nasty offensive threat with finishing ability and a big body that’s tough to deal with. In a series so even, with over 60 minutes of overtime played after three games, his absence looms as the potential back-breaker for Chicago. Apparently he’s going to play in Game 4, but if he’s seriously hindered, so are they.
2. Tough, clean hockey
We don’t generally talk about dirty hits in hockey until there is one, and this season there was no shortage. But it came across my inner brain-screen pretty early in the first period: for all the big, cringe-inducing hits in the last few weeks of hockey, players have really reined it in (the cleanliness of said hits, I mean). David Krejci absolutely crushed Jonathan Toews last night, and neither player so much as looked at the other after. Just “Good?” “Good.” “Good.”
Maybe there’s just been less games, or maybe Raffi Torres was eliminated. Both are reasonable options. Whatever the case, it’s been a pleasure to not have to deal with. Read the rest of this entry »
Posted by Scott Johnson under MLB: The Show, PS3, Baseball, Sony on Jun 18, 2013
Yasiel Puig fans rejoice as a new roster update for MLB 13: The Show is out, and this update feature Dodgers rookie Yasiel Puig. Though the Dodgers are in last place, Puig is off to one of the best rookie starts in MLB history.
Puig has an overall rating of 87, “A” potential, and a 92 arm strength. Be sure to download the update for your PS3’s.
Posted by Joseph Casciaro under Alvin Williams, Kyle Lowry, Tim Leiweke, Masai Ujiri on Jun 17, 2013
As Tim Leiweke stressed the need for improvement for an organization that wasn’t good enough and Masai Ujiri talked about building his own small staff here in Toronto, many of us were able to foresee the organizational house cleaning around the corner. So when guys like Ed Stefanski and Jim Kelly were let go, I don’t think anyone around the team was exactly floored.
But I don’t know how many people saw this coming, as fans and media alike were surprised to hear the news on Monday that former fan-favourite Alvin Williams had been relieved of his duties as a scout. In addition, Doug Smith reports that CEO Tim Leiweke made the decision and that General Manager Masai Ujiri never spoke to Alvin.
Coming into Sunday at the 113th U.S. Open, the story was all about Phil Mickelson and his pursuit of his national championship. With five runner-up finishes, the most in the history of the event, Mickelson had some unfinished business with this tournament and the USGA. As is the case usually on U.S. Open Sunday, the winner would be crowned on Father’s Day, and with Mickelson seen as the ideal family man and loving father, the golf media worked itself into quite the lather leading into the final round. Did I mention that Sunday was also his 43rd birthday? You couldn’t write this stuff. The problem is, nobody told Justin Rose that he wasn’t supposed to win.
Even for the most ardent of golf fans, Rose has been a bit of an enigma. He first appeared on the national stage as an amateur in the 1998 Open Championship, where he ended up tied for fourth place at 17 years old. He turned pro the next day but struggled with his game, going winless until the 2002 Dunhill Championship. His father Ken, who had been fighting cancer, passed away soon after that victory. A few more wins and inconsistencies followed until Rose hired Sean Foley at the end of the 2009 season, leading to victories at huge PGA Tour events like the Memorial, AT&T, BMW and WGC-Cadillac, but the major championship still eluded him.
Highs and lows are common on the golf course, even for the professionals, but it’s magnified at the U.S. Open, where the USGA does it’s very best to manipulate the course in a way that protects par, as if the best players in the world breaking it would cause some kind of cataclysmic event. The list of players who missed the cut on Friday was littered with some of the game’s best, including twelve major champions. Another nine major winners who made the cut never threatened the leaders on the weekend.
Posted by Sean Tomlinson under Announcements on Jun 15, 2013
Hello kind readers. I hope you’re enjoying a fine sunny Saturday filled with the many beverages of the season, and as you’re checking in now briefly to see what you could have possibly missed around the NFL on a mid-June weekend, you’re delighted to see the story Vladamir Putin pwning Robert Kraft. This league is truly filled with endless treasure.
But alas, you’ll have to enjoy that bottomless pit of comedy without me for a brief time. This is me telling you that I’m taking a little vacation away from a job in which I write about football.
I’m escaping to a far off Ontario mountain destination few men have traveled, and I’ve only packed enough supplies for three nights. If you guys don’t hear from me by Wednesday morning — when regular daily content will resume, god willing — then send help.
Surely nothing will happen in my absence on a Monday and Tuesday in June, right? Hmmm, let’s look back at this past Monday:
- Tim Tebow was signed by the Patriots
- Chad Johnson slapped his lawyer’s ass, and a judge wildly overreacted
- And Adam “Pacman” Jones handled a confrontation with his patented calmness
Welp, OK then. See ya later.