Tuesday, October 16, 2012

Bogosity Alert!!!



Bogosity Alert! Bogosity Alert!

Wait till I tell you about who’s coming to sleepy good ol’ U. N. of H.:  the wares this man is peddling are inherently suspect– and that’s the reason for the alert. On the other hand, there’s a good chance he’ll blow your mind.
Bruce Bueno de Mesquita will lecture here on campus on Wednesday, October 24.  Bruce is a social scientist – a Professor at NYU and fellow at the Stanford’s Hoover Institution - that has had the temerity to venture onto the world of forecasting.  The tool of his trade is game theory – the mathematical modeling of interactions between parties to a transaction.  He has built a game theory model that enables him to analyze and predict social outcomes – and a successful consulting practice based on it.
In game theory the focus is (at the outset) on two key factors.  First, is the assumption that players are rational, that is to say recognizing that what drives our decisions is nothing more complicated than doing what is good for Number One.  The second component is to recognize that very few outcomes in our social world are entirely our own doing.  By far when it comes to the things that matter, results and outcomes depend on our actions and the actions of others.
The elementary game theory model used to explain how the elements of this framework work together is the prisoners’ dilemma.   And even if you are not familiar with the game or its formal structure – it’s more than likely that you are familiar with the logic. The prisoners’ dilemma and related game theoretic structures underscore the plot in numerous sitcoms/movies.  We find it in the now classic War Games (the one with Matthew Broderick) in which the computer ultimately discovers that the only winning move is “not to play” and in Denzel and Gene Hackman’s Crimson Tide, in which a US nuclear submarine is seemingly instructed to launch a pre-emptive strike on Russia but is unable to obtain confirmation when the radio is destroyed.  The strategic nature of the interaction emerges starkly: Denzel: “In my humble opinion, in the nuclear world, the true enemy is war itself.” But it’s not only in popular culture.  We find instances of game theory applications everywhere.  Game theory models underscore the ranking algorithms in Google searches, voting models such as the popular Intrade, matching models like those in Netflix, as well as the bidding models used in E-Bay and much more.
Why is being able to predict successfully such a big-deal in the social sciences?  Well, ‘cause successful prediction is what separates the chaff from the wheat (and there’s very little wheat, frankly), the ultimate, the triple-crown, the holy grail of it all. Cause till now we do it badly, very badly.  Does anyone remember the Berlin Wall?; the Arab Spring; and dare I bring it up, - the financial meltdown?  Did anyone see it coming?  Big fat no: here’s the latest (in what is now a veritable torrent) chest- thumping from economists and the great financial quant Emanuel Derman.
Models are abstractions – they circumscribe time and space, limit the number of actors and actions and establish cause and effect.  Events in the social sciences are visualizations of an interesting slice (to us) of a complex adaptive system. And when we intervene – be it a prediction or a policy prescription, the system will change – or not: the point being that we don’t know what will happen to it.  Put differently, often the best we can do – when it comes to model based predictions - is to make broad pattern predictions or provide explanations of the system’s underlying principles.   As a result, anyone venturing into the forecasting business – especially trying to predict anything with any meaningful detail – is more likely than not going to be wrong. 
So – here’s the mind-blowing thing, the reason for the too-good-to-be-true alerts. De Mesquita has been wildly successful at the prediction thing.  In his words, “According to a declassified CIA assessment, the predictions for which I’ve been responsible have a 90 percent accuracy rate.” His feats are documented in great detail in his book The Predictioneer’s Game (2009) where he describes in rich, intricate detail the subtle combinations of all of his model’s constituent elements and predictions in a simple, elegant manner.  In fact, probably because he has been right so many times he has become a bona fide academic superstar.  Predictioneering success has brought him his own TED TALK, appearances in many popular sites: several instances in Big Think and a guest many times in my favorite show: EconTalk with Russ Roberts. 
The cool thing about De Mesquita’s game-theoretic forecasting model is that it is portable.  Its framework is built with elements that can be replaced and substituted with the particular narrative data necessary to illustrate cause and effect, drawn from the different contexts in which the model is deployed – like a car: on the inside an automobile is internal combustion; outside, it can become a Lexus or a Hummer, red, automatic, two-seater, or blue.  De Mesquita ranges widely: he analyzes and predicts outcomes of wars, voting outcomes, regime change, corporate lawsuits and even the Israeli-Palestinian conflict. 
Generally, when someone is hyping a prediction based on some fancy model we probably only hear about the model’s successes. To appraise the performance of any model one must also know how many times the model has been wrong.  De Mesquita acknowledges –and rebuts this pitfall up front:   “Of course, it will be much more convincing if you go back over the book’s predictions, as well as forecasts I have made online in speeches, podcasts and so forth, and judge for yourself. There is always the danger that I will unwittingly focus on the best of my predictions and give less credence to those that were wrong, but I will certainly try not to do that; “and there  you have it: he is so brazen, and so good at what he does – that he is daring you to call him on it.
And we will. And I’m sure he flubs and will flub forecasts on occasion.  But you should expect that error creeps in everywhere – and Bruce will not always get it right.  Establishing how many times the model’s prediction went awry is not the only criteria we must evaluate.  And getting it wrong does not necessarily mean the model is wrong.  And herein is the task for us, the audience, when you show up at Dodds Auditorium at 12:30 pm next Wednesday, 24th.
To fully determine the quality of a model we need to know not only when the model gets it right but most importantly, whether it was right either by coincidence or because of the model’s capability.  And, similarly, when it gets it wrong, we should know whether it was either the luck of the draw or that the model flawed.  Alas, in many social science events – the counterfactual – what would have happened but for what did happen- is unknowable.  So how are we to figure this out?
The essence of modeling – as we have noted in previous blogs – is to select salient elements of a situation and set forth their interplay in a manner that conforms to understood principles of natural and social behavior.  Your task is to deploy your knowledge of understood principles of natural and – especially – social behavior to determine whether they impart sufficient discipline on the model’s inner workings for us to ascertain the power of game theory modeling.
Be prepared to be wowed – especially when he gets it right.  And even if he gets it wrong. 

arod

arodriguez@newhaven.edu


Tuesday, October 9, 2012

Public Education and the Regulatory State


Guest blogger Lesley  DeNardis is an Associate Professor of Political Science at Sacred Heart University, a member of the Hamden Board of Education, and a former UNH Professional in Residence in Economics and Public Administration.  She can be contacted at denardisl@sacredheart.edu. The issues she addresses in this contribution are to be found in greater detail in her forthcoming 2013 book: Who’s Minding the Gap?: Institutions, Ideas, and Interests Shaping Education Policy in Connecticut.  


Public Education and the Regulatory State

Let’s face it.  Education mandates are not the first words that come to mind when we raise the subject of the regulatory state.  What often springs to mind are burdensome requirements on businesses that impede economic growth.  Rolling back the regulatory state usually calls for some type of deregulation aimed at fostering growth in the private sector.  Yet, education mandates, a stealth form of taxation that fly under the radar, present just as much a threat to economic competiveness and growth for Connecticut.
Connecticut watchers already know that the Constitution state is among the most highly regulated environments for business.  The Tax Foundation ranked Connecticut 40th among states in terms of business tax climate. (www.taxfoundation.org).  What may have escaped most people’s attention is the fact that education regulations comprise the largest single source of regulation in Connecticut.  An estimated eighty percent of new mandates each legislative session are in the area of public education. These regulations passed down from the state legislature in the form of mandates to local school districts are one of the largest cost drivers for school districts and are arguably just as much a drag on the economy as business regulation.  In fact, the Connecticut Business and Industry Association, the leading business interest group in Connecticut, identified unfunded education mandates as a looming economic problem in Connecticut.  In a 2006 survey  http://www.cbia.com/newsroom/Surveys/State_Mandate_Survey.htm, the CBIA found that among the myriad problems facing municipalities, local officials identified unfunded education mandates as the most problematic.  Unfunded mandates burden local school budgets and contribute to property tax increases creating an overall unfriendly business climate in Connecticut.  Relief from education mandates should be part and parcel of any education reform package.
What should be done?
A little known law passed in 1977 requires the Connecticut state legislature to sunset laws that are deemed obsolete.  The main thrust of the law was to allow legislators to weed out obsolete regulations.  Despite the passage of this law, the CGA has only conducted sunset review once over the last thirty years.  Every five years the legislature decides to postpone sunset review.  The result – thousands of state laws are still on the books which may no longer be necessary and may be unduly burdensome.  Education policy was not included in this original legislation which has been all but ignored by the CGA.  Another route to review has been taken by our neighbors to the south and provides an example of a proactive approach.  The Governors of New York and New Jersey have empanelled commissions to conduct regulatory review of education mandates.   The work of the commission has just been completed and the recommendations are being acted upon by their respective state legislatures.
Some inroads into this problem were made a few years ago when Governor Rell commissioned a panel to study mandate relief.  The work of the commission culminated in proposed legislation “An Act Providing Relief to Municipalities” during the 2009 legislative session which would have required a two thirds vote of the legislature to approve any new mandate and a section dealing with binding arbitration reform.  Unfortunately, the bill did not pass the state legislature.  The Connecticut General Assembly should revive the commission’s recommendations and act favorably upon them.
In addition to periodic reviews of existing regulation, a similar process should be undertaken before any new mandates are proposed.  Legislators ought to ask whether the intended rule or regulation actually addresses the issue at hand.  For example, as part of the education reform package passed by the Connecticut General Assembly in 2010, the state mandated new high school graduation requirements that added 2-3 more courses for a high school student to graduate.  This mandate imposes costs on the school district in the form of hiring additional teachers.  It is of dubious value since it is based on the perception that more courses translate into better prepared or more knowledgeable high school graduates.   The measure drew sharp criticism from local superintendents of schools when they questioned the intrinsic educational merit of more courses and the attendant costs.  There were many such regulations that were part of the heralded 2010 and 2012 education reform packages.  Greater consultation and input from local officials should be solicited to determine whether the goal of a mandate might be better accomplished in another fashion.  While many of these goals may be laudable, they have imposed increased costs on school districts in order to be implemented.    Public input and consultation with local educators and officials would have found a different and perhaps more cost effective path.
Unfunded education mandates have caused school district budgets to skyrocket in recent years.  Tackling these stealth taxes will be one way to foster greater economic competitiveness.  Connecticut should embrace mandate relief a as one part of a multifaceted attempt to address its fiscal woes and become more economically competitive.   
denardisl@sacredheart.edu