Pilot program was designed to first ground students in the basics of empirical research, then provide an opportunity to apply that knowledge while conducting fieldwork in an international setting.

The Freeman Spogli Institute for International Studies (FSI) and Office of International Affairs (OIA) launched a pilot collaboration last year to provide a rigorous, immersive teaching and training program for students interested in international fieldwork.  The result was a program that included a quarter-long course in the spring of 2015 followed by three weeks in Mexico during the summer to design and conduct a field research study. OIA spoke with Frank Wolak, the Holbrook Working Professor of Commodity Price Studies in Economics and Senior Fellow at FSI, to learn more about the project, titled International Field Research Training: Energy Reform in Mexico.

What was the impetus for designing a program for students with a field research component?

While students at Stanford have many opportunities to pursue independent research projects, they rarely have the opportunity to receive first-hand training in conducting interviews, research design and field implementation. With that in mind, we set out to design a program that would carry the students through the basics of empirical research and then give them the opportunity to apply that knowledge under close faculty supervision. Taking students out of the classroom and giving them the opportunity to see textbook methods in action is invaluable.

Our hope is that this training equips the students with the academic and logistical skills they need to execute their own robust research, be that for an honors thesis, a capstone project or an advanced degree.

How did the prerequisite course prepare students for working in the field? 

The Stanford course taught the basics of the design, implementation and interpretation of social science field research. Building on a basic knowledge of statistical methods and economics, the course first introduced observational field research and compared it with experimental field research. Significant attention was devoted to explaining what can and cannot be learned through each type of field research.

Topics covered included sample size selection, power and size of statistical hypothesis tests, sample selection bias and methods for accounting for it. Examples of best practice field research studies were presented as well as examples of commonly committed experimental design and implementation errors. Practical aspects of fieldwork were also covered, including efficient and cost-effective data collection, data analysis, teamwork and common ethical considerations.

After completing the quarter-long course on statistical research methods, the students, under the guidance of the Program on Energy and Sustainable Development's research team, adapted an education-based research intervention for the Mexican electricity sector. The purpose was to see if providing individuals with information about how their energy bill was calculated and simple ways to reduce household electricity consumption would cause household energy bills to go down.

What was a typical day for the students gathering research?

Research was carried out in the city of Puebla, a city of 1.5 million people about 150 kilometers (93 miles) southeast of Mexico City. The Stanford students collaborated with students from the Universidad Popular Autónoma del Estado de Puebla (UPAEP). For the first few days, the students all met at an UPAEP classroom space to design and review the survey tool, making revisions and conducting practice interviews.

Once oriented in Puebla, the students set out daily in research teams to interview randomly selected households in middle-income neighborhoods in Puebla. The students branched out from a central meeting place in teams of three, pairing two Stanford students with one UPAEP student.

In the field, the students all wore nametags and UPAEP baseball caps to make themselves identifiable as surveyors to households. They worked in the field for eight to 10 hours a day, taking about an hour break for lunch. In the first few days, they were able to collect 15-20 surveys a day, but as they became more comfortable with their pitch and knocking on doors, they were able to increase their yield to a high of 44 surveys in one day. At the end of two weeks, they completed over 260 surveys in just 10 days of fieldwork.

The students were also active on social media documenting their daily activities. For more on the student perspective, their activities and impressions of the project, check out their blog on the FSI website. 

What are the benefits for getting in-country field research experience?

There are a variety of situation-specific problems that are hard for any researcher to know fully without being immersed in the field. For example, one of the students' recommendations to improve energy efficiency was to switch household light bulbs from incandescent to compact fluorescents (CFL). This is a valid recommendation in the United States where most people still use incandescent bulbs in their homes, but – surprisingly to the team – most of the people interviewed had already converted to all CFLs in their home.

I was amazed with the students; the level of intellectual curiosity and engagement was impressive with ongoing discussions into the evening at times. The students were not only getting an in-country immersive experience while conducting research, but they were also developing critical thinking skills along the way.

Research aside, the in-country experience gave the students a keen understanding of how local residents live. The methodology employed for gathering data allowed the students to connect with many types of families, ranging from senior citizens living alone to multi-generational families living under one roof. Through direct contact with the community, the students developed an understanding of the local culture and learned local customs. 

Conducting international research at Stanford can be challenging. Where did you turn to for advice on how to structure your activity?

At FSI, we have a great wealth of experiential knowledge on conducting field research all over the world. In addition to consulting with faculty and research managers at FSI, OIA had been enormously helpful in connecting us with resources across campus and facilitating some of the trickier logistics, such as processing stipend payments to our international collaborators and navigating the human subjects approval process. OIA was also able to discern that Puebla was a viable option as a research site.

How would you characterize the success of the pilot program? 

The pilot program exceeded our expectations in the best possible ways. Much of its success was due to the work of Elena Cryst ,'10, program manager for FSI's Global Student Fellows Program, who also accompanied us on our trip. She was an invaluable team leader and organizer and worked tirelessly to ensure that both the research and logistical aspects of the trip ran smoothly.

We will definitely be offering the field research course and research project again. We hope to go to another part of Latin America next, such as Chile or Colombia. We are also still active in Mexico, with three of the students that went on the trip working for us as research assistants this academic year, analyzing the data as it comes in and developing a self-administered online version of the survey instrument with which we hope to reach thousands of households in Puebla.

In addition, Elena will be using our experiences from the Mexico pilot to inform other FSI field research programs in China, Guatemala, India and potentially new sites for next year.

This article was originally published in The Stanford Report on October 27, 2015.

For 14 years, Mariano-Florentino Cuéllar has been a tireless Stanford professor who has strengthened the fabric of university’s interdisciplinary nature. Joining the faculty at Stanford Law School in 2001, Cuéllar soon found a second home for himself at the Freeman Spogli for International Studies. He held various leadership roles throughout the institute for several years – including serving as co-director of the Center for International Security and Cooperation. He took the helm of FSI as the institute’s director in 2013, and oversaw a tremendous expansion of faculty, research activity and student engagement. 

An expert in administrative law, criminal law, international law, and executive power and legislation, Cuéllar is now taking on a new role. He leaves Stanford this month to serve as justice of the California Supreme Court and will be succeeded at FSI by Michael McFaul on Jan. 5.

 As the academic quarter comes to a close, Cuéllar took some time to discuss his achievements at FSI and the institute’s role on campus. And his 2014 Annual Letter and Report can be read here.

You’ve had an active 20 months as FSI’s director. But what do you feel are your major accomplishments? 

We started with a superb faculty and made it even stronger. We hired six new faculty members in areas ranging from health and drug policy to nuclear security to governance. We also strengthened our capacity to generate rigorous research on key global issues, including nuclear security, global poverty, cybersecurity, and health policy. Second, we developed our focus on teaching and education. Our new International Policy Implementation Lab brings faculty and students together to work on applied projects, like reducing air pollution in Bangladesh, and improving opportunities for rural schoolchildren in China.  We renewed FSI's focus on the Ford Dorsey Program in International Policy Studies, adding faculty and fellowships, and launched a new Stanford Global Student Fellows program to give Stanford students global experiences through research opportunities.   Third, we bolstered FSI's core infrastructure to support research and education, by improving the Institute's financial position and moving forward with plans to enhance the Encina complex that houses FSI.

Finally, we forged strong partnerships with critical allies across campus. The Graduate School of Business is our partner on a campus-wide Global Development and Poverty Initiative supporting new research to mitigate global poverty.  We've also worked with the Law School and the School of Engineering to help launch the new Stanford Cyber Initiative with $15 million in funding from the Hewlett Foundation. We are engaging more faculty with new health policy working groups launched with the School of Medicine and an international and comparative education venture with the Graduate School of Education. 

Those partnerships speak very strongly to the interdisciplinary nature of Stanford and FSI. How do these relationships reflect FSI's goals?

The genius of Stanford has been its investment in interdisciplinary institutions. FSI is one of the largest. We should be judged not only by what we do within our four walls, but by what activity we catalyze and support across campus. With the business school, we've launched the initiative to support research on global poverty across the university. This is a part of the SEED initiative of the business school and it is very complementary to our priorities on researching and understanding global poverty and how to alleviate. It's brought together researchers from the business school, from FSI, from the medical school, and from the economics department.  

Another example would be our health policy working groups with the School of Medicine. Here, we're leveraging FSI’s Center for Health Policy, which is a great joint venture and allows us to convene people who are interested in the implementation of healthcare reforms and compare the perspective and on why lifesaving interventions are not implemented in developing countries and how we can better manage biosecurity risks. These working groups are a forum for people to understand each other's research agendas, to collaborate on seeking funding and to engage students. 

I could tell a similar story about our Mexico Initiative.  We organize these groups so that they cut across generations of scholars so that they engage people who are experienced researchers but also new fellows, who are developing their own agenda for their careers. Sometimes it takes resources, sometimes it takes the engagement of people, but often what we've found at FSI is that by working together with some of our partners across the university, we have a more lasting impact.

Looking at a growing spectrum of global challenges, where would you like to see FSI increase its attention? 

FSI's faculty, students, staff, and space represent a unique resource to engage Stanford in taking on challenges like global hunger, infectious disease, forced migration, and weak institutions.  The  key breakthrough for FSI has been growing from its roots in international relations, geopolitics, and security to focusing on shared global challenges, of which four are at the core of our work: security, governance, international development, and  health. 

These issues cross borders. They are not the concern of any one country. 

Geopolitics remain important to the institute, and some critical and important work is going on at the Center for International Security and Cooperation to help us manage the threat of nuclear proliferation, for example. But even nuclear proliferation is an example of how the transnational issues cut across the international divide. Norms about law, the capacity of transnational criminal networks, smuggling rings, the use of information technology, cybersecurity threats – all of these factors can affect even a traditional geopolitical issue like nuclear proliferation. 

So I can see a research and education agenda focused on evolving transnational pressures that will affect humanity in years to come. How a child fares when she is growing up in Africa will depend at least as much on these shared global challenges involving hunger and poverty, health, security, the role of information technology and humanity as they will on traditional relations between governments, for instance. 

What are some concrete achievements that demonstrate how FSI has helped create an environment for policy decisions to be better understood and implemented?

We forged a productive collaboration with the U.N. High Commissioner for Refugees through a project on refugee settlements that convened architects, Stanford researchers, students and experienced humanitarian responders to improve the design of settlements that house refugees and are supposed to meet their human needs. That is now an ongoing effort at the UN Refugee Agency, which has also benefited from collaboration with us on data visualization and internship for Stanford students. 

Our faculty and fellows continue the Institute's longstanding research to improve security and educate policymakers. We sometimes play a role in Track II diplomacy on sensitive issues involving global security – including in South Asia and Northeast Asia.  Together with Hoover, We convened a first-ever cyber bootcamp to help legislative staff understand the Internet and its vulnerabilities. We have researchers who are in regular contact with policymakers working on understanding how governance failures can affect the world's ability to meet pressing health challenges, including infectious diseases, such as Ebola.

On issues of economic policy and development, our faculty convened a summit of Japanese prefectural officials work with the private sector to understand strategies to develop the Japanese economy.  

And we continued educating the next generation of leaders on global issues through the Draper Hills summer fellows program and our honors programs in security and in democracy and the rule of law. 

How do you see FSI’s role as one of Stanford’s independent laboratories?

It's important to recognize that FSI's growth comes at particularly interesting time in the history of higher education – where universities are under pressure, where the question of how best to advance human knowledge is a very hotly debated question, where universities are diverging from each other in some ways and where we all have to ask ourselves how best to be faithful to our mission but to innovate. And in that respect, FSI is a laboratory. It is an experimental venture that can help us to understand how a university like Stanford can organize itself to advance the mission of many units, that's the partnership point, but to do so in a somewhat different way with a deep engagement to practicality and to the current challenges facing the world without abandoning a similarly deep commitment to theory, empirical investigation, and rigorous scholarship.

What have you learned from your time at Stanford and as director of FSI that will inform and influence how you approach your role on the state’s highest court?

Universities play an essential role in human wellbeing because they help us advance knowledge and prepare leaders for a difficult world. To do this, universities need to be islands of integrity, they need to be engaged enough with the outside world to understand it but removed enough from it to keep to the special rules that are necessary to advance the university's mission. 

Some of these challenges are also reflected in the role of courts. They also need to be islands of integrity in a tumultuous world, and they require fidelity to high standards to protect the rights of the public and to implement laws fairly and equally.  

This takes constant vigilance, commitment to principle, and a practical understanding of how the world works. It takes a combination of humility and determination. It requires listening carefully, it requires being decisive and it requires understanding that when it's part of a journey that allows for discovery but also requires deep understanding of the past.