Wednesday, May 22, 2019

Evidence Based Management

academy of screwment check up on 2006, Vol. 31, No. 2, 256269. 2005 Presidential Address IS THERE SUCH A THING AS EVIDENCEBASED MANAGEMENT? DENISE M. ROUSSEAU Carnegie Mellon University I explore the forestall organization investigate offers for improved caution make out and how, at present, it falls short. Using yard-based medicine as an exemplar, I identify ship federal durationncy of closing the prevailing look for- cause gapthe failure of organizations and managers to base formulas on better available demo.I close with guidance for investigateers, educators, and managers for translating the rationales governing human expression and organisational processes into more effective instruction practice. grounds-based solicitude means translating principles based on trounce present into organizational practices. done present-based commission, practicing managers develop into experts who make organizational decisions conscious by social science and organizationa l researchp craft of the zeitgeist moving professional decisions away from personal preference and unsystematic give birth toward those based on the best available scientific tell apart (e. . , Barlow, 2004 DeAngelis, 2005 LemieuxCharles & Champagne, 2004 Rousseau, 2005 Walshe & Rundall, 2001). This links how managers make decisions to the continually expanding research base on cause-effect principles underlying human behavior and organizational actions. here(predicate) is what evidence-based prudence looks like. lets call this example, and true horizontal surface, Making Feedback People-Friendly. The executive get upor of a health c be system with twenty rural clinics nones that their military operation differs tremendously across the array of metrics used.This variability has nonhing to do with patient mix or employee characteristics. After interviewing clinic fellow members who complain virtually the sheer enactment of metrics for which they be accountable (200 i ndicators sent This expression is based on the address I gave at the annual meeting of the honorary society of counsel in Honolulu, Hawaii. Chuck Bantz, Andy Garman, capital of Minnesota S. Goodman, Ricky Griffin, Bob Hinings, Paul Hirsch, Sharon McCarthy, Sara Rynes, Laurie Weingart, and John Zanardelli contributed ideas toward its development. 256 onthly, comparing each clinic to the 19 others), the director recalls a principle from a long-ago course in psychology human decision manufacturing airs digest only process a hold in amount of information at any(prenominal) one snip. With input from clinic ply, a redesigned feedback system bespeaks shape. The new-fangled system uses three performance categories bang quality, cost, and employee satisfactionand smokes a summary measure for each of the three. Over the next year, through preparation of feedback in a more interpretable form, the health systems performance improves across the board, with low-performing units showi ng the niftyest improvement.In this example a principle (human beings idler process only a limited amount of information) is translated into practice ( generate feedback on a small set of critical performance indicators using damage people readily understand). Evidence-based management, as in the example above, derives principles from research evidence and translates them into practices that solve organizational enigmas. This isnt ever easy. Principles be credible only where the evidence is clear, and research findings can be tough for both researchers and practitioners to interpret.Moreover, practices that capitalize on a principles insights must befit the setting (e. g. , who is to say that the particular(prenominal) performance indicators the executive director uses ar pertinent to all units? ). Evidence-based management, despite these challenges, promises more consistent attainment of organizational goals, including those affecting employees, stockhold- 2006 Rousseau 2 57 ers, and the public in general. This is the promise that attracted me to organizational research at the beginning of my bring offer but it remains unfulfilled.THE GREAT HOPE AND THE GREAT DISAPPOINTMENT It is ironic that I came to write this article in my bureau as the sixtieth Academy of Management president. Management was a nasty word in my blue collar childhood, where everyone in the family was moved(p) by how the company my father range ated for managed its employees. When the supervisor frequently called my father to ask him to put in more overtime in an already long fiddle week, all of us kids got used to covering for him. If the phone rang when my father was home, hed view us answer it. We all knew what to say if it was the company occupation Dads not here. The idea of just telling the supervisor that he didnt want to conk out never occurred to my father, or anyone else in the family. The bane of disciplinary action or job loss loomed large, reinforced by dinner time stories about a bosss abusive behavior or more or little inexplicable company action. From this vantage point, the term management connotes harsh and arbitrary behavior, with undertones of otherness. It is a far cry from the dictionary definition of management as a judicious use of means to accomplish an end (Merriam-Webster, 2005).I selectd a wholly new perspective on management and managers when I became a business acquire professor. First, some(prenominal) business educatees, even at the MBA level, turn in never experienced what it is like to work for a good manager. In the inaugural business course I taught, in organizational behavior, I gave the students two assignments (1) write about the bruise boss you ever had, describing what made that person the worst and how it impacted you, and (2) write about the best boss you ever had, describing what made that person the best and how it impacted you.My MBA students with an average of five years of regular work experie nce had no problem with assignment 1. For many of them, the assignment was cathartic, and they frequently exceeded its assigned page limit in writing vituperative portrayals of managers motleyly presented as self-centered, capricious, or otherwise lacking in capability or character. Assign- ment 2 was another matter. Many students had great difficulty thinking of anyone who dependant as the best manager. Over a third couldnt think of any boss they could even describe as good.To the extent that people manage others the way they themselves grant been managed, I came to worry about what the future held for these managers-in-the- reservation. Nonetheless, while these business students may never gull had a great boss, they themselves still hoped to become one. (By the way, I own since abandoned this assignment in favor of more selfreflection on the manager students want to become and ways they can develop themselves to move closer to that ideal. ) Second, approximately business s tudents have never worked for a great company either. There is the possibility that only dissatisfied people quit their jobs to study full time for an MBA, but in this regard I suspect availability bias. ) I never have had any difficulty getting students to sh atomic number 18 their experiences of dysfunctional organizational practices. However, when it comes to identifying a more functional way to motivate workers or restructure firms, they ar often at a loss. Still, in-class discussions and students consume future plans suggest that they do hope to join a company (or to start one) that is better managed than those they have worked for so far.In class and out, I have spent a divide of time helping students check off how to make a business case, with their future employers in mind, for creating financially successful firms that are good for people too. I have come to feel tremendous respect and affection for those students who have the personal aspiration to be a great manager i n a great company. Out of these personal and professional experiences, I have nurtured my great hopethat, through research and development, we can raise effective organizations where managers make well-informed, less arbitrary, and more reflective decisions.My great disappointment, however, has been that research findings dont appear to have transferred well to the workplace. Instead of a scientific understanding of human behavior and organizations, managers, including those with MBAs, protract to rely largely on personal experience, to the exclusion of more systematic knowledge. Alternatively, managers follow bad advice from business books or consultants based on weak evidence. Because diddly Welch or 258 Academy of Management Review April McKinsey says it, that doesnt make it true. Several decades of research on attribution bias indicate that people have a difficult time drawing unbiased conclusions regarding why they are successful, often giving more credit to themselves than the facts warrant. Management gurus are in no way immune. ) Sadly, there is poor uptake of management practices of cognise effectiveness (e. g. , goal setting and performance feedback Locke & Latham, 1984). Even in businesses populated by MBAs from top-ranked universities, there is un repaird wide variation in managerial practice patterns (e. g. how or if goals are set, selection decisions made, rewards allocated, or bringing up investments determined) and, worse, persistent use of practices known to be largely powerless (e. g. , downsizing Cascio, Young, & Morris, 1997 high ratios of executive to rankand-file employee compensation Cowherd & Levine, 1992). The result is a research-practice gap, indicating that the answer to this articles title question is noat least not yet. What it means to close this gap and how evidencebased management might become a reality are the matters I turn to next.THE EVIDENCE-BASED ZEITGEIST The phrase evidence-based is a buzzword in contemporary pu blic policy, with all the risk of triteness and superficiality that buzzword status conveys. Lets not be misled by its received popularity. Evidence-based practice has tremendous substance and discipline behind it. We can observe its impact in two fields highly influenced by legislative decisions policing and secondary education. In evidence-based policing, community police officers are trained to treat criminal suspects politely, because doing so has been found to reduce repeat offenses (Sherman, 2002 Tyler, 1990).In evidence-based education, many secondary schools have restored the practice of social promotion, where students who have difficulty passing their courses, even after several tries, are advanced to the next grade level. Research indicates that social promotions benefits outweigh its costs, because a high school diploma increases the likelihood of subsequent employment and lowers the incidence of drug use, even among students who wouldnt otherwise have qualified for th at diploma (Jimerson, Anderson, & Whipple, 2002 National Association of School Psychologists, 2005).Evidence-based practice is a paradigm for making decisions that integrate the best available research evidence with decision maker expertise and client/customer preferences to guide practice toward more desirable results (e. g. , Sackett, Straus, Richardson, Rosenberg, & Haynes, 2000). Proponents are skeptical about experience, wisdom, or personal credentials as a basis for asserting what works. The question is What is the evidence? not Who says so? (Sherman, 2002 221). The answer, as the criminologist Lawrence W.Sherman indicates, can be graded from weak to strong, based on rules of scientific inference, where in advance-and-after comparisons are stronger than simultaneous correlationsrandomized, controlled tests stronger than longitudinal cohort analyses. Strong evidence trumps weak, irrespective of how charismatic the evidences presenter is. Sherman sums it up We are all entitled to our own opinions, but not to our own facts (2002 223). Medicine is a success story as the branch domain to institutionalize evidence-based practice. Evidence-based medicine is the integration of individual clinical expertise and the best external evidence.Its origins date back to 1847, when Ignaz Semmelweis discovered the role that infection played in childbirth fever. Semmelweis was vilified by physicians of the time for his assertion that it was doctors themselves who were infecting women by carrying germs in the midst of dead bodies and patients. Nonetheless, his work influenced the formulation of germ supposition, which gained coincideance with the work of Lister and Pasteur forty years later (Wikipedia, 2005). Extensive infrastructures advance evidence-based health sustainment (e. g. , the U. S.National Institutes of health and Institute of Medicine, the Canadian Health Services Research Foundation, and the Cochrane Collaboration). Evidence-based-clinical care as a way of animateness in health care organizations is of relatively recent vintage, enjoying its greatest egress after 1990. (If you are wondering what physicians did in the beginning, the answer is what managers are doing now, but without medicines added advantages from common professional training and malpractice sanctions. ) The attributes of evidencedbased medicine provide a useful reference point 2006 Rousseau 259 for exploring what its counterpart in management might look like.By way of example, germ theory is widely understood by clinical care givers. It has led to broad application of infection control systems (gowns, sterile motifles, and sterile instruments), medicines to avoid or redress infections, and supporting practices (handwashing). Its application has led to radical but important interpretations of gainmingly distant events. Incidence of heart attack, for example, increases immediately after having ones dentition cleaned. Reflecting on this correlation in light of germ theory led to recognition that teeth cleaning disperses mouth bacteria into the hearts arteries. definite bacteria in these arteries create conditions that give rise to heart attacks. Recognizing this causal link led to a risk-reducing solution giving heart patients antibiotics to take before dental treatments as a preventive. This application of medical evidence involved cause-and-effect connections how dental practice can disperse mouth bacteria into the hearts arteries. It in like manner required isolation of variations that affect desired outcomes, requiring knowledge of the mechanisms triggering heart attacks (and, in this case, knowledge that gum disease may itself trigger heart attacks see, for instance, Desvarieux et al. 2005). and more than scientific insight is needed to create evidence-based practice. In fact, only some physicians recommend this preventive action for their heart patients. Others may not see the risk as that great, are unaware of the finding, or merely have forgotten to make this preventive action part of their standard orders for cardiac patients. The enfolding of other practitioners further complicates matters dentists are not necessarily educated to inquire about heart conditions. Organizational factors affect whether evidence-based practice occurs.In health care settings certain features increase the likelihood that an at-risk patient depart get the preventive medication. Social networks and organizational culture matter. It helps if the patients physician is part of a practice or a hospital where others recommend such preventive care. Similarly, impeding this evidence-based practice is the fact that dentists are unlikely to be in the homogeneous professional networks as physicians. In a hospital where medical leadership promotes evidencebased medicine, more physicians are likely to e aware of the finding. Such settings are besides likely to have staff in-services to update physician knowledge where this practice m ight be discussed. Relatedly, participation in research increases the salience of the evidence base. It helps if physicians in the immediate environment have participated in clinical research and are engaged in one of the several online communities that review clinical evidence and soce create and disseminate recommendations, which raises the next point access to information on those practices the evidence supports.Physicians have online services that provide ready access to clinical practice best supported by research, based on the review and recommendation of health care experts (e. g. , Cochrane Collaboration). Such services capitalize on the information blowup and internet connections to build communities of practice enabling experts to communicate their knowledge, identify the best-quality evidence, and disseminate it broadly to care givers (Jadad, Haynes, Hunt, & Browman, 2000). Decision supports can be designed to make it easier to action evidence-based practices.A patient care protocol might be written specifying that each heart patient and all post-op cardiac cases be advised of the need to premedicate before teeth cleaning, along with a prescription written for and given to the patient at discharge. This protocol might be formalized to the extent that a premedication instruction is written in each cardiac patients discharge orders. Last, a web of factorsindividual (knowledge), organizational (access to knowledgeable others, support for evidence use), and institutional (dissemination of evidence-based practice)promotes, sustains, and institutionalizes evidence-based medicine.Britains national health system, for example, promotes evidencebased practice using the Cochrane Collaborations recommendations as the standard. Medicare in the United States publishes information on whether hospitals use proven remedies in patient care (Kolata, 2004). In sum, features characterizing evidencebased practice include light uponing about cause-effect connections in professional practices isolating the variations that measurably affect desired outcomes 260 Academy of Management Review April creating a culture of evidence-based decision making and research participation using information-sharing communities to reduce overuse, underuse, and misuse of ad hoc practices building decision supports to promote practices the evidence validates, along with techniques and artifacts that make the decision easier to execute or perform (e. g. , checklists, protocols, or standing orders) and having individual, organizational, and institutional factors promote access to knowledge and its use. Now allows consider what such practice might mean for management and organizations.WHY EVIDENCE-BASED MANAGEMENT IS IMPORTANT AND TIMELY Evidence-based management is not a new idea. Chester Barnard (1938) promoted the development of a natural science of organization to better understand the unanticipated problems associated with sourceity and consent. Since Barn ards time, however, we have struggled to connect science and practice without a vision or model to do so. Evidence-based management, in my opinion, provides the needed model to guide the closing of the research-practice gap. In this section I address why evidence-based management is timely and practical.Calling Attention to Facts Big E Evidence and little e evidence An evidence orientation shows that decision quality is a direct function of available facts, creating a demand for reliable and valid information when making managerial and organizational decisions. Improving information continues a elan begun in the quality movement over thirty years ago, giving systematic fear to discrete facts, indicative of quality (e. g. , machine performance, customer interactions, employee attitudes and behavior Evans & Dean, 2000).This trend continues in recent developments regarding open-book management (Case, 1995 Ferrante & Rousseau, 2001) and the use of organizational fact finding and exper imentation to improve decision quality (Pfeffer & Sutton, in press). In all the attention we now give to evidence, it helps to differentiate what might be called Big E Evidence from little e evidence. Big E Evidence refers to generalizable knowledge regarding cause-effect connections (e. g. , specific goals promote higher attainment than general or vague goals) derived from scientific method actingsthe focus of this article.Little e evidence is local or organization specific, as exemplified by root cause analysis and other fact-based approaches the total quality movement introduced for organizational decision making (Deming, 1993 Evans & Dean, 2000). It refers to data systematically gathered in a particular setting to inform local decisions. As the saying goes, facts are our friends, when local efforts to accumulate information relevant to a particular problem lead to more effective solutions. Although decision makers who rely on scientific principles are more likely to gather fact s systematically in order to pick out an appropriate course of action (e. . , Sackett et al. , 2000), fact gathering (evidence) doesnt necessarily lead decision makers to use social science knowledge (Evidence) in interpretating these facts. In my introductory example of the health care system, the executive director might have concluded that the performance differences across the twenty clinics were out-of-pocket to something about the clinics or their managers. It was his knowledge of a basic principle in psychology that gave him an alternative and, ultimately, more effective interpretation.However, systematic attention to local facts can prompt managers to look for principles that account for their observations. The opening example illustrates how scientific principles and local facts go together to solve problems and make decisions. Opportunity to come apart Implement managerial Decisions In highly competitive environments, good execution may be as important as the strategic choices managers make. Implementation is a strong suit of evidence-based management through the wealth of research available to guide effective execution (e. g. , goal setting and feedback Locke & Latham, 1984 feedback and redesign Goodman, 2001).Indeed, with greater orientation toward scientific evidence, health care managements guidelines frequently reference social and organizational research on implementation (e. g. , Lemieux-Charles & Champayne, 2004 Lomas, Culyer, McCutcheon, 2006 Rousseau 261 McAuley, & Law, 2005). The continued wide variation we observe in how organizations execute decisions (e. g. , in goal clarity, stakeholder participation, feedback processes, and allowance for redesign) is remarkable, given the advanced knowledge we possess about effective implementation and what is at stake should implementation fail.Better Managers, Better Learning Given the powerful impact managers decisions have on the fate of their firms, managerial competence is a critical and ofte n scarce resource. meliorate managerial competence is a direct outgrowth of a greater focus on evidencebased management. Managers need real learning, not fads or false conclusions. When managers acquire a systematic understanding of the principles governing organizations and human behavior, what they learn is validthat is to say, it is repeatable over time and generalizable across websites. It is less likely that what managers learn will be wrong.Today, the poor information commonly available to managers regarding the organizational consequences of their decisions means that experiences are likely to be misinterpreted subject to perceptual gaps and misunderstandings. Consider the case of a supervisor who overuses threats and punishment as behavioral tools. A punisher who keys on the fact that punishing suppresses behavior can comp permitely miss its other consequenceits softness to encourage positive behavior. Status differences and organizational politics make it unlikely that the punisher will learn the true consequences of that style, by limiting and distorting feedback.The reality is that managers tend to work in settings that make valid learning difficult. This difficulty is compounded by the widespread uptake of organizational fads and fashions, adopted overenthusiastically, implemented inadequately, then discarded untimely in favor of the up-to-the-minute trend (Walshe & Rundall, 2001 437 see also Staw & Epstein, 2000). In such settings managers cannot even learn why their decisions were wrong, let alone what alternatives would have been right. Evidence-based management leads to valid learning and continuous improvement, rather than a checkered career based on false assumptions.Organizational legitimacy is another product of evidence-based management. Where decisions are based on systematic causal knowledge, conditioned by expertise leading to successful implementation, firms find it easier to deliver on promises made to stockholders, employees, cu stomers, and others (e. g. , Goodman & Rousseau, 2004 Rucci, Kirn, & Quinn, 1998). Legitimacy is a result of making decisions in a systematic and informed fashion, thus making a firms actions more readily justifiable in the eyes of stakeholders.Yet, given evidence-based managements numerous advantages, why then is the research-practice gap so large? I next turn to the array of factors that set to perpetuate this evidence-deprived status quo. WHY MANAGERS DONT PRACTICE EVIDENCE-BASED MANAGEMENT The research-practice gap among managers results from several factors. First and foremost, managers typically do not know the evidence. less(prenominal) than 1 percent of HR managers read the academic literature regularly (Rynes, Brown, & Colbert, 2002), and the consultants who advise them are unlikely to do so either.Despite the explosion of research on decision making, individual and group performance, business strategy, and other domains directly tied to organizational practices, few pract icing managers access this work. (I note, however, that of the four periodicals the Academy publishes, it is the empirical Academy of Management ledger to which company libraries most widely subscribe. So there is some recognition that this research exists ) Evidence-based management can threaten managers personal immunity to run their organizations as they see fit.A similar resistance characterized supervisory responses to scientific management nearly 100 years ago, when Frederick Taylors structured methods for up(a) efficiency were discarded because they were believed to interfere with managements prerogatives in supervising employees. Part of this pushback stems from the belief that good management is an artthe romance of leadership school of thought (e. g. , Meindl, Erlich, & Dukerich, 1985), where a shift to evidence and analysis connotes loss of creativity and autonomy. Such concerns are not unique physicians have wrestled with similar dilemmas, expressed in 62 Academy of M anagement Review April the aptly titled article False Dichotomies EBM, Clinical Freedom and the Art of Medicine (Parker, 2005). managerial work itself differs from clinical work and other fields engaged in evidencebased practice in important ways. First, managerial decisions often involve long time lags and little feedback, as in the case of a recruiter hiring someone to eventually take over a senior position in the firm. Years may pass before the true quality of that decision can be discerned, and, by then, the recruiter and others involved are likely to have moved on (Jaques, 1976).Managerial decisions often are influenced by other stakeholders who impose constraints (Miller, 1992). Obtaining stakeholder support can involve politicking and compromise, altering the decision made, or even whether it is made at all. Incentives tied to managerial decisions are subject to contradictory pressures from senior executives, stockholders, customers, and employees. Last, its not always obviou s that a decision is being made, given the array of interactions that compose managerial work (Walshe & Randall, 2001).A manager who declines to train a subordinate, for example, may not realize that particular act ultimately may lead the employee to quit. Evidence-based management can be a tough sell to many managers, because management, in contrast to medicine or nursing, is not a profession. Given the diverse backgrounds and education of managers, there is limited understanding of scientific method. With no formally mandated education or credentials (and even an MBA is no guarantee), practicing managers have no body of divided up knowledge.Lacking shared scientific knowledge to add weight to an evidence-based decision, managers commonly rely on other bases (e. g. , experience, formal power, incentives, and threats) when making decisions acceptable to their superiors and constituents. Firms themselvesparticularly those in the private welkin contribute to the limited value placed on science-based management practice. Although pharmaceutical firms advertise their investment in biotechnology and basic research, the typical business does not have the advancement of managerial knowledge in its mission.Historically leading corporations such as Cadbury, IBM, and General Motors were officiously engaged in research on company selec- tion and training practices, employee motivation, and supervisory behavior. Their efforts contributed substantially to the early managerial practice evidence base. But few organizations directly do their own managerial research or regularly collaborate with those who do, despite the considerable benefits from industry-university collaborations (Cyert & Goodman, 1997) the globally experienced time crunch in managerial work and the press for short-term results have reduced such collaborations to dispensable frills.Nonetheless, hospitals participate in clinical research and school systems evaluate policy interventions. In contrast to more evidence-oriented domains, such as policing and education, management is most often a private sector activity. It is less influenced by public policy pressures promoting similar practices while creating comparative advantage via distinctiveness. Businesses are characterized by the belief that the particulars of the organization, its practices, and its problems are special and uniquea widespread phenomenon termed the uniqueness riddle (Martin, Feldman, Hatch, & Sitkin, 1983).Observed among clinical care givers and law enforcement practitioners too, the uniqueness paradox can interfere with transfer of research findings across settingsunless dispelled by better education and experience with evidencebased practice (e. g. , Sackett et al. , 2000). Yet, despite all these factors, the most important understanding evidence-based management is still a hope and not a reality is not due to managers themselves or their organizations. Rather, professors like me and the programs in which we te ach must accept a large measure of blame. We typically do not educate managers to know or use scientific evidence.Research evidence is not the substitution focus of study for undergraduate business students, MBAs, or executives in continuing education programs (Trank & Rynes, 2003), where case examples and popular concepts from nonresearch-oriented magazines such as the Harvard Business Review take center stage. Consistent with the diminution of research in behavioral course work, business students and practicing managers have no ready access to research. No communities of experts vet research regarding effective management practice (in contrast to the collaboratives that vet health care, criminal justice, and educational research e. . , Campbell Collaboration, 2006 Rousseau 263 2005 Cochrane Collaboration, 2005). Few MBAs determine a peer-reviewed journal during their student days, let alone later. Consequently, its time to look critically at the role we educators play in limitin g managers knowledge and use of research evidence. EVIDENCE-BASED MANAGEMENT AND OUR section AS EDUCATORS My biggest surprise as the Academy president turned out to be the most frequent topic of emails sent to me by Academy members complaints about our journals from self-identified direction-oriented members.A typical email goes like this I want to let you know what a waste the Academy journals are. Theres nothing in them at all pertinent to my teaching. The Academy should be for everybody, not just researchers. My first response was to feel guilty (why hadnt I seen this? ). But then I started to think more deeply about what this message implies. It says that educators arent finding ideas in journals that cause them to change what they teach. This might mean that current research is irrelevant to whats being taught if educators focus on other topics.It could mean that the kind of information research articles provide about principles or practices is insufficient to determine what settings or circumstances their findings apply to. Or it could even mean that professors arent updating their course material when research findings differ from what they teach. These emails prompted me to wonder what exactly we are teaching. If we are teaching what research findings support, the content of a class has to change from time to time, with new evidence or better-specified theory.The concern that prompted this address stemmed from these emails the role we educators play in the research-practice gap. How Professors Contribute to the ResearchPractice Gap Management education is itself often not evidence based, something Trank and Rynes implicitly recognize (2003) as the dumbing down of management education. They also persuasively demonstrated that, in place of evidence, behavioral courses in business schools focus on general achievements (e. g. , team building, fight man- agement) and current case examples.Through these stimulating, ostensibly relevant activities, we ca pture student interest, helping to deflect the criticism How is this going to help me get my first job? Business schools reinforce this by relying heavily on student ratings instead of assessing real learning (Rynes, Trank, Lawson, & Ilies, 2003). Stimulating courses and active learning must be core features of training in evidence-based management, because these educational features are good pedagogy. The manner and content of our approaches to behavioral courses perpetuate the research-practice gap.Weak Research-Education Connection Pick up any popular management textbook and you will find that Frederick Herzbergs work lives, but not Max Webers. Herzbergs longdiscredited two-factor theory is typically included in the motivation section of management textbooks, despite the fact that it was discredited as an artifact of method bias over thirty years ago (House & Wigdor, 1967). I asked a famous author of many best-selling textbooks why this was so. Because professors like to teach H erzberg he answered. Students want updated business examples but cant really tell if the research claims are valid. This conversation suggests that professors are likely to teach what they learned in graduate school and not necessarily what current research supports. (Since many management professors are adjuncts valued for their practical experience but are from diverse backgrounds, even educators of comparable professional age may not share scientific knowledge. ) I suspect that the persistence of Herzberg will continue until all the professors who learned the twofactor theory in graduate school (c. 960 1970) retire. However, business schools may discourage inclusion of some well-substantiated topics because they dont sound managerial. Paul Hirsch, the well-known sociologist, tells the story that when he flies business class, his seatmates ask what he does for a living. When he identifies himself as a business school professor, the next customary question is What do you teach? As a sociologist steeped in Weber and the century of research he spawned, Paul used to say, Bureaucracy. His seatmates frequently 264Academy of Management Review April moved to the opposite wing at that point, until Paul wised up and found a more appeal response Management (personal communication). Paul notes that managers still need to understand bureaucratic processes, so he hasnt changed what he teaches only what he calls it. I do this too I no longer call socialization, training, and rules substitutes for leadership (Kerr & Jermier, 1978), having found that the last thing a would-be manager wants to hear is how he or she can be replaced. The implications are clear.We frame, and perhaps even slant, what we teach to make it more palatable. Can it be we are on that slippery slope of avoiding teaching the most current social science findings relevant to managers and organizations, from downsizing to ethical decision making, because we fear our audience wont like the implications? Failure to Manage Student Expectations Student expectations do drive course content, and current evidence indicates that there is a strong preference for turnkey, ready-to-use solutions to problems these students will face in their first jobs (Trank & Rynes, 2003).What efforts do we make to manage these expectations? Unless students are persuaded to value sciencebased principles and their own role in turning these principles into sound organizational practice, it will be nigh hopeless for faculty to resist the pressure to teach only todays solutions. We might start by asking students who they think updates more effectivelypractitioners trained in solutions or in principles. Effective practices in 2006 need not be the same as those in 2016, let alone 2036, when the majority of todays business students will still be working.If we teach solutions to problems, such as how to obtain accurate information on a workers performance, students will acquire a toolperhaps, for example, 360-degr ee feedback. Yet they wont understand the underlying cognitive processes (whether feedback is task related or self-focused), social factors (the relationships between ratees and raters), and organizational mechanisms (used for developmental purposes or compensation decisions), which explain how, when, and why 360-degree feedback might work (or not).Imagine a doctor who knows to prescribe antibiotics to patients with bronchitis (a common recommendation in the 1980s before recognition of antibiotic overuse Franklin, 2005) but doesnt understand the basic physiology that can lead other therapies to be comparable, more effective, or have fewer downsides. In the case of feedback, basic social science research is quite robust regarding how feedback impacts behavior (Kinicki & Kreitner, 2003). Such knowledge is likely to take broader utility and more durable solutions over time than training in any particular feedback tool.Lack of Models for Evidence-Based Management Case methods are de ri gueur in business schools, helping to develop students analytic skills and familiarity with conditions they will face as practicing managers. The cases that I find most effective are those that have an individual manager as a protagonist (as opposed to those that describe an organization without developing one or two central personalities). A central character creates tension and evokes student identification with the events taking place.That character is typically a manager, who can be the change agent responsible for solving the problem or a accelerator for the dysfunctional behavior on which the cases focuses. Either way, students have a modela positive or negative referentfrom which they can learn how to make out (or not) in the future. As with most complex behaviors, from parenting to managing, people learn better when they have competent models (Bandura, 1971). Nonetheless, in twenty-five years of using cases in class, I cannot recall a single time in which a protagonist re flected on research evidence in the course of his or her decision making.No Expectation for Updating Evidence-Based Knowledge Throughout the Managers Career Upon graduation, few business students recognize that the knowledge they may have acquired can be surpassed over time by new findings. Although social science knowledge continues to expand, business school training does not prepare graduates to tap into it. Neither students nor managers have clear ideas of how to update their knowledge as new evidence emerges. 2006 Rousseau 265 There are few models of what an expert manager knows that a novice does not (see Hill, 1992, for an exception).In contrast, expert nurses are known to behave in very different ways from novices or less-than-expert midcareer nurses (Benner, 2001). They more rapidly size up a situation accurately and deal simultaneously with more co-occurring factors. In the professions, extensive postgraduate development exists to deepen expertise to produce a higher quali ty of practice. In contrast, business schools often imply that MBAs know all they need to know when they graduate. WHAT WE CAN DO TO CLOSE THE RESEARCH-PRACTICE GAP There is a lot we can do to close the researchpractice gap, both as individual educators and through working incarnately.Manage Student Expectations We can manage student expectations with regard to the role of behavioral course work in the students broader career. I often introduce myself to full-time students by telling them that the easiest teaching I do has always been to executives, because these experienced managers come to the program convinced that human behavior and group processes are the most critical things they need to learn. At this point in their careers, our full-time students can only be novices whose expertise will grow with time and active effort on their part to understand the dynamics of behavior in organizations.Try asking students what the difference is between ten years of experience and one year of experience repeated ten times. Then let them forecast what ten years of experience in becoming more expert on behavior and group processes in organizations would look like (the types of job, people, settings, etc. ). Let them also imagine this for one year repeated ten times. Reflecting on these contrasting visions of their careers gives students an opportunity to raise their expectations of themselves as professional managers.There are various related means for managing expectations, including the creation of learning contracts based on the learners anticipated future roles, the behavioral knowledge and skills these roles will necessitate, and how that knowledge and skill will be acquired in the course (Goodman, 2005). It is easier to do this as part of a larger curriculum framed by anticipated future rolesthe would-be-managers story (Schank, 2003). Important also is the next feature providing models of evidence-based practice and evidence-based managers.Provide Models of Evid ence-Based Practice We need to model evidence-based practice in our teaching and in the curriculum. mental research on learning offers a useful guide for course/curriculum practices (e. g. , Kersting, 2005). These include exposing the learner to models of competent evidence-based managers. I have been fortunate to encounter such a person. John Zanardelli is the CEO of Asbury Heights, the Methodist Home for the Aged, Mt. Lebanon, Pennsylvania. I first met John in an executive course on change management at Carnegie Mellon.He peppered me with questions about skills, information, and management tactics and wanted to know the research support behind my answers. Trained as an epidemiologist, John understands the scientific method and regularly looks for scientific corroboration of ideas he comes across in popular management books and from self-proclaimed experts. (Not surprisingly, the calls for evidence-based management largely have come from health care professionals and scholars e. g . , DeAngelis, 2005 Kovner, Elton, & Billings, 2005. I knew that I was seeing an unusual manager, to say the least, when John, face up with the need to redesign his organizations compensation practices, went off to the Carnegie Mellon library to read J. Stacy Adams equity theory His organizations vision statement is built just about the concept Where Loving Care and Science Come Together. Managers such as John Zanardelli provide exemplars of the complex set of proficiencies required to become a master management practitioner. Using them as examples reinforces the notion that the typical twenty-something student is a novice taking first steps along the path to becoming an expert (e. . , Benner, 2001 Hill, 1992). Active practice, self-reflection, and feedback are core learning principles (Schon, 1983). ? Developing student competence through active practice entails project work supported by ongoing reflection and debriefing regarding what constitutes valid learning and effective be havior. Similarly, our educational practices, 266 Academy of Management Review April courses, and curricula need that same reflection and evolution to effectively model evidencebased teaching. Promote Active Use of Evidence Students need to know that evidence is available, and they need to learn how to apply it.This necessitates a balance between teaching principlesthat is, cause-effect knowledgeand practicesthat is, solutions to organizational problemsthough the mix is subject to dispute (Bennis & OToole, 2005). In the spirit of making the course tell a story students can understand and participate in, a course conveying how a novice becomes an expert manager, like any good story, involves a succession of experiences, trials, failures, and successes (Schank, 2003). That story line is marked by the acquisition of distinctly different kinds of knowledge.There is declarative knowledge regarding principles or cause-effect relationships. Students can acquire principles in a variety of w ays. They might address the appropriateness of group incentives versus individual incentives by locating evidence in a textbook, in journals, or online. Informing students of the evidence through lectures and books has its place, but there is value in identifying and deriving the principles themselves from the sources that will remain available to them throughout their careers.Students can learn a good deal from actively accessing evidence, using it to solve problems, reflectingand trying again. Indeed, one of the most powerful forms of learning may be deriving principles from experience and reflection, as when students review cases and then derive the principles governing the underlying outcomes (Thompson, Gentner, & Loewenstein, 2003). Thompson and her colleagues found that students learned better when they developed principles from cases than when they derived solutions, a finding consistent with basic psychological research on learning (Anderson, Fincham, & Douglass, 1997).Actua lly using evidence takes a metaskill the ability to turn evidence-based principles into solutions. A form of procedural knowledge, a solution-oriented approach to evidence use is comparable to product design, where end users and knowledgeable others familiar with the situation in which the product will be used jointly participate in specifying its features and functionality. Perhaps one of the first products of behavioral research in organizations was the revolving spindle restaurants use to convey customer orders to the kitchen.William Foote Whyte (1948) discovered that status differences between restaurent wait staff (typically female) and the (male) chef led to conflicts, because chefs disliked taking orders from women. The revolving order spindle to which waitresses could attach an order and spin it in the direction of the kitchen allowed customer orders to be conveyed impersonally, reducing workplace conflict and improving communication. Other researchbased products include dec ision supports such as checklists to guide a performance review or action plans to conduct meetings in ways that build consensus (e. . , Mohrman & Mohrman, 1997), effectively translating the evidence into guides for action. Build Collaborations Among Managers, Researchers, and Educators As the saying goes, it takes a village to educate people. Changing how we educate managers in professional schools necessitates a collective attitude and behavior shift among educators, researchers, current managers, and recruiters. Pfeffer and Suttons (in press) book calls attention to managerial heroespeople who use evidence to turn troubled companies around and/or to create sustained successes.As in the case of any change in collective attitudes (Gladwell, 2002), turning evidence-based management from a practice of a prognosticative few into the mainstream requires champions credible people like Pfeffer and Suttons managerial heroesto advertise its value. Networks of individuals, excited by what evidence-based management makes possible, need to exist to disseminate it to others. maven such collaborative network might parallel the Cochrane Collaboration in medicine and the Campbell Collaboration in criminal justice and education. Such a community has been advocated to promote evidenced-based management of health care organizations Kovner et al. , 2005, suggesting that communities of experts might effectively be built around the management of specific kinds of organizations. ) Each represents a worldwide community of experts created to provide ready access to a particular 2006 Rousseau 267 body of evidence and the practices it supports. Community members, practitioners as well as researchers, collaborate in summarizing stateof-the-art knowledge on practices known to be important.Information is presented in sufficient detail regarding evidence and sources of outcome variation to reduce underuse, overuse, and misuse. While these communities are geographically distributed, they also sponsor face to face meetings to promote community building, commitment, and learning. Their major product is online access to information, designed for easy use. EVIDENCE-BASED PRACTICE CAN BE MISUNDERSTOOD On a cautionary note, the differentiate evidencebased practice can be misapplied. It can be used to characterize superficial practices (another companys so-called best practice or the latest tool consultants are selling).Alternatively, it can be used as a club (the kind with a nail in it) to force compliance with a standard that may not be universally applicable. One downside of poor implementation of evidence-based medicine is the challenge the British health care system has faced owing to the use of the Cochrane Collaborations recommendations to regulate clinical care decisions, with enforcement of the recommendations regardless of their suitability for particular patients (Eysenbach & Kummervold, 2005). Evidence-based practice is not onesize-fits-all its the best curr ent evidence coupled with informed expert judgment.OUR OWN ZEITGEIST PROMOTING EVIDENCE-BASED PRACTICE OF MANAGEMENT Forty years elapsed between Semmelweiss discoveries and the formulation of germ theory. One hundred years later, even basic infectionreducing practices such as hand washing still are not consistently performed in hospitals (Johns Hopkins Medicine, 2004). Considering the personal growth and social and organizational changes evidence-based practice requires, our own evidence-based management zeitgeist still has plenty of time to run. The first challenge is consciousness raising regarding the rich array of evidence that can improve effectiveness of managerial decisions.Educating opinion leaders, including prominent executives and educators, in the nature and value of evidence-based approaches builds champions who can get the word out. Updating management education with the latest research must be ongoing, demanding that educators and textbook writers apprise themselves o f new research findings. The onus is on researchers to make generalizability clearer by providing better information in their reports regarding the context in which their findings were observed. All parties need to put greater emphasis on learning how to translate research findings into solutions.In the case of researchers, too a good deal information that might affect the translations of findings to practice remains tacit, in the apparent minutiae research reports omit, known only to the researcher. Educators need to help students acquire the metaskills for designing solutions around the research principles they teach. Managers must learn how to experiment with possible evidence-based solutions and to adapt them to particular settings. We need knowledgesharing networks composed of educators, researchers, and manager/practitioners to help create and disseminate management-oriented research summaries and practices that best evidence supports.Building a culture in which managers lear n to learn from evidence is a critical aspect of effective evidence use (Pfeffer & Sutton, in press). Developing managerial competence historically has been viewed as a training issue, underestimating the investment in collective capabilities that is needed (Mohrman, Gibson, & Mohrman, 2001). The promises of evidence-based management are manifold. It affords higher-quality managerial decisions that are better implemented, and it yields outcomes more in line with organizational goals.Those who use evidence (E and e) and learn to use it well have comparative advantage over their less competent counterparts. Managers, educators, and researchers can learn more systematically throughout their careers regarding principles that govern human behavior and organizational actions and the solutions that enhance contemporary organizational performance and member experience. A focus on evidence use may also ultimately help to blur the boundaries between researchers, educators, and managers, creat ing a lively community with many feedback loops where information is sys- 268 Academy of Management ReviewApril tematically gathered, evaluated, disseminated, implemented, reevaluated, and shared. The promise of evidence-based management contrasts with the staying power or stickiness of the status quo. Like the QWERTY keyboard created for manual typewriters, but inefficient in the age of word processing, management-asusual survives, despite being out of step with contemporary needs. Failure to evolve toward evidence-based management, however, is costlier than mere inefficiency. It deprives organizations, their members, our students, and the general public of greater success and better managers. enthrall join with me in working to make evidence-based management a reality. REFERENCES Anderson, J. R. , Fincham, J. M. , & Douglass, S. 1997. The role of examples and rules in the acquisition of a cognitive skill. Journal of Experimental Psychology Learning, Memory, and Cognition, 23 93294 5. Bandura, A. 1971. Social learning theory. New York General Learning Press. Barlow, D. H. 2004. Psychological treatments. American Psychologist, 59 869 878. Barnard, C. I. 1938. Functions of the executive. Cambridge, MA Harvard University Press. Benner, P. 2001.From novice to expert Excellence and power in clinical nursing practice (commemorative ed. ). Menlo Park, CA Addison-Wesley. Bennis, W. G. , & OToole, J. 2004. How business schools lost their way. Harvard Business Review, 82(3) 96 104. Campbell Collaboration. 2005. http//www. campbellcollaboration. org/, accessed December 5. Cascio, W. F. , Young, C. E. , & Morris, J. K. 1997. Financial consequences of employment-change decisions in major U. S. corporations. Academy of Management Journal, 40 11751189. Case, J. 1995. Open-book management The coming business revolution. New York Harper Business.Cochrane Collaboration. 2005. http//www. cochrane. org/ index0. htm, accessed December 5. Cowherd, D. , & Levine, D. I. 1992. Produc t quality and pay equity between lower-level employees and top management An investigation of distributed justice theory. Administrative Science Quarterly, 37 302320. Cyert, R. M. , & Goodman, P. S. 1997. Creating effective university-industry alliances An organizational learning perspective. Organizational Dynamics, 25(4) 4557. DeAngelis, T. 2005. Shaping evidence-based practice. APA Monitor, 35(3) 26 31. Deming, W. E. 1993. The new economics for industry, government, and education.Cambridge, MA mamma Institute of Technology. Desvarieux, M. , Demmer, R. T. , Rundek, T. , Boden-Abala, B. , Jacobs, D. R. , Jr. , Sacco, R. L. , & Papapanou, P. N. 2005. Periodontal microbiota and carotid intima-media thickness The oral infections and vascular disease epidemiology study (INVEST). Circulation, 111 576 582. Evans, J. R. , & Dean, J. W. , Jr. 2000. Total quality Management, organization, and strategy (2nd ed. ). Cincinnati South-Western Publishing. Eysenbach, G. , & Kummervold, P. E. 200 5. Is cybermedicine killing you? The story of a Cochrane disaster. Journal of Medical Internet Research, 7(2) article e21.Ferrante, C. J. , & Rousseau, D. M. 2001. Bringing open book management into the academic line of sight. In C. L. Cooper & D. M. Rousseau (Eds. ), Employee versus owner issues (Trends in Organizational Behavior Series), vol. 8 97116. Chichester, UK Wiley. Franklin, D. 2005. Antibiotics arent always the answer. New York Times, August 30 D5. Frieze, I. H. 1976. Causal attributions and information seeking to explain success and failure. Journal of Research in Personality, 10 293305. Gladwell, M. 2002. The tipping point How little things can make a big difference. New York Back Bay Books. Goodman, P. S. 001. Missing organizational linkages. Newbury Park, CA Sage. Goodman, P. S. 2005. The organizational learning contract. Working paper, Tepper School of Business, Carnegie Mellon University, Pittsburgh. Goodman, P. S. , & Rousseau, D. M. 2004. Organizational change tha t produces results. Academy of Management Executive, 18(3) 719. Hill, L. A. 1992. Becoming a manager How new managers master the challenges of leadership. capital of Massachusetts Harvard Business School Press. House, R. J. , & Wigdor, L. A. , 1967. Herzbergs dual-factor theory of job satisfaction and motivation. Personnel Psychology, 23 369 389. Jadad, A. R. Haynes, R. B. , Hunt, D. , & Browman, G. P. 2000. The internet and evidence-based decision-making A needed synergy for efficient knowledge management in health care. Canadian Medical Association Journal, 162 362365. Jaques, E. 1976. (Reprinted in 1993. ) A general theory of bureaucracy. London Gregg Revivals. Jimerson, S. R. , Anderson, G. , & Whipple, A. 2002. Winning the battle and losing the war Examining the relation between grade retention and dropping out of high school. Psychology in the Schools, 39441 457. Johns Hopkins Medicine. 2004. Expert on hospital infections talks about hand washing. http//www. opkinsmedicine. or g/Press_releases/2004/10_28_04. html, October 28. Kersting, K. 2005. consolidation research into teaching. APA Monitor, 35(1) 19. Kerr, S. , & Jermier, J. M. 1978. Substitutes for leadership Their meaning and measurement. Organizational Behavior and Human Performance, 22 375 403. 2006 Rousseau 269 and quality in human service work 33 46. Munich Hampp. Kinicki, A. , & Kreitner, R. 2003. Organizational behavior Key concepts, skills and best practices. New York McGrawHill. Kolata, G. 2004. Program coaxes hospitals to see treatments under their noses. New York Times, December 2 A1, C8.Kovner, A. R. , Elton, J. J. , & Billings, J. D. 2005. Evidence-based management. Frontiers of Health Services Management, 16(4) 324. Lemieux-Charles, L. , & Champagne, F. 2004. Using knowledge and evidence in healthcare Multidisciplinary perspectives. Toronto University of Toronto Press. Locke, E. A. , & Latham, G. P. 1984. Goal setting A motivational technique that works. Englewood Cliffs, NJ Prentice-H all. Lomas, J. , Culyer, T. , McCutcheon, C. , McAuley, L. , & Law, S. 2005. Conceptualizing evidence for health system guidance. Final report to Canadian Health Services Research Foundation, Ottawa, Ontario.Martin, J. , Feldman, M. , Hatch, M. , & Sitkin, S. B. 1983. The uniqueness paradox in organizational stories. Administrative Science Quarterly, 28 438 453. Meindl, J. R. , Erlich, S. B. , & Dukerich, J. M. 1985. The romance of leadership. Administrative Science Quarterly, 30 78 101. Miller, G. J. 1992. Managerial dilemmas The political economy of hierarchy. Cambridge Cambridge University Press. Mohrman, S. A. , Gibson, C. B. , & Mohrman, A. M. 2001. Doing research that is useful to practice A model and empirical exploration. Academy of Management Journal, 44 357375. Mohrman, S. A. , & Mohrman, A. M. Jr. 1997. Designing and leading team-based organizations A workbook for organizational self-design. San Francisco Jossey-Bass. National Association of School Psychologists (NASP). 2005. Position statement on grade retention and social promotion. www. nasponline. org/information/pospaper_ graderetent. html, accessed November 24. Parker, M. 2005. False dichotomies, EBM, clinical freedom and the art of medicine. Medical Humanities, 31 2330. Pfeffer, J. , & Sutton, R. I. In press. Hard facts, dangerous half-truths, and total nonsense Profiting from evidencebased management. Boston Harvard Business School Press.Rousseau, D. M. 2005. Evidence-based management in health care. In C. Korunka & P. Hoffmann (Eds. ), Change Rucci, A. J. , Kirn, S. P. , & Quinn, R. T. 1998. The employeecustomer-profit chain at Sears. Harvard Business Review, 76(1) 8297. Rynes, S. L. , Brown, K. G. , Colbert, A. E. 2002. Seven common misconceptions about human resource practices Research findings versus practitioner beliefs. Academy of Management Executive, 18(3) 92103. Rynes, S. L. , Trank, C. Q. , Lawson, A. M. , & Ilies, R. 2003. Behavioral coursework in business education Growing evid ence of a legitimacy crisis.Academy of Management Learning & Education, 2 269 283. Sackett, D. L. , Straus, S. E. , Richardson, W. S. , Rosenberg, W. , & Haynes, R. B. 2000. Evidence-based medicine How to practice and teach EBM. New York Churchill Livingstone. Schank, R. C. 2003. Every curriculum tells a story. Unpublished manuscript, Carnegie Mellon University, Pittsburgh. ? Schon, D. 1983. The reflective practioner How professionals think in action. London Temple Smith. Sherman, L. W. 2002. Evidence-based policing Social organization of information for social control. In E. Waring & D. Weisburd (Eds. ), Crime and social organization 217 248.New Brunswick, NJ Transaction. Staw, B. , & Epstein, L. 2000. What bandwagons bring Effects of popular management techniques on corporate performance, reputation, and CEO pay. Administrative Science Quarterly, 43 523556. Thompson, L. , Gentner, D. , & Lowenstein, J. 2003. Avoiding missed opportunities in managerial life Analogical training more powerful than individual case training. In L. L. Thompson (Ed. ), The social psychology of organizational life 163173. New York Psychology Press. Trank, C. Q. , & Rynes, S. L. 2003. Who moved our cheese? Reclaiming professionalism in business education.Academy of Management Learning & Education, 2 189 205. Tyler, T. 1990. Why people obey the law. New Haven, CT Yale University Press. Walshe, K. , & Rundall, T. G. 2001. Evidence-based management From theory to practice in health care. Milbank Quarterly, 79 429 457. Whyte, W. F. 1948. Human relations in the restaurant industry. New York McGraw-Hill. Denise M. Rousseau (emailprotected edu) is past president of the Academy of Management and H. J. Heinz II Professor of Organizational Behavior and Public Policy at Carnegie Mellon University, jointly in the Heinz School of Public Policy and Management and the Tepper School of Business.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.