{"id":654,"date":"2013-06-03T12:07:40","date_gmt":"2013-06-03T12:07:40","guid":{"rendered":"http:\/\/blogs.oii.ox.ac.uk\/policy\/?p=654"},"modified":"2020-12-07T14:25:44","modified_gmt":"2020-12-07T14:25:44","slug":"how-accessible-are-online-legislative-data-archives-to-political-scientists","status":"publish","type":"post","link":"https:\/\/ensr.oii.ox.ac.uk\/how-accessible-are-online-legislative-data-archives-to-political-scientists\/","title":{"rendered":"How accessible are online legislative data archives to political scientists?"},"content":{"rendered":"
\"House
A view inside the House chamber of the Utah State Legislature. Image by deltaMike<\/a>.<\/figcaption><\/figure>\n

Public demands for transparency in the political process have long been a central feature of American democracy, and recent technological improvements have considerably facilitated the ability of state governments to respond to such public pressures.\u00a0With online legislative archives, state legislatures can make available a large number of public documents. In addition to meeting the demands of interest groups, activists, and the public at large, these websites enable researchers to conduct single-state studies, cross-state comparisons, and longitudinal analysis.<\/p>\n

While online legislative archives are, in theory, rich sources of information that save researchers valuable time as they gather data across the states, in practice, government agencies are rarely completely transparent, often do not provide clear instructions for accessing the information they store, seldom use standardized norms, and can overlook user needs. These obstacles to state politics research are longstanding: Malcolm Jewell noted almost three decades ago the need for \u201ca much more comprehensive and systematic collection and analysis of comparative state political data.\u201d While the growing availability of online legislative resources helps to address the first problem of collection, the limitations of search and retrieval functions remind us that the latter remains a challenge.<\/p>\n

The fifty state legislative websites are quite different; few of them are intuitive or adequately transparent, and there is no standardized or systematic process to retrieve data. For many states, it is not possible to identify issue-specific bills that are introduced and\/or passed during a specific period of time, let alone the sponsors or committees, without reading the full text of each bill. For researchers who are interested in certain time periods, policy areas, committees, or sponsors, the inability to set filters or immediately see relevant results limits their ability to efficiently collect data.<\/p>\n

Frustrated by the obstacles we faced in undertaking a study of state-level immigration legislation before and after September 11, 2001, we decided to instead\u00a0 evaluate each state legislative website \u2014 a \u201cstate of the states\u201d analysis \u2014 to help scholars who need to understand the limitations of the online legislative resources they may want to use. We evaluated three main dimensions on an eleven-point scale: (1) the number of searchable years; (2) the keyword search filters; and (3) the information available on the immediate results pages. The number of searchable sessions is crucial for researchers interested in longitudinal studies, before\/after comparisons, other time-related analyses, and the activity of specific legislators across multiple years. The \u201csearch interface\u201d helps researchers to define, filter, and narrow the scope of the bills\u2014a particularly important feature when keywords can generate hundreds of possibilities. The \u201cresults interface\u201d allows researchers to determine if a given bill is relevant to a research project.<\/p>\n

Our paper builds on the work of other scholars and organizations interested in state policy. To help begin a centralized space for data collection, Kevin Smith and Scott Granberg-Rademacker publicly invited \u201cresearchers to submit descriptions of data sources that were likely to be of interest to state politics and policy scholars,\u201d calling for \u201ccentralized, comprehensive, and reliable datasets\u201d that are easy to download and manipulate. In this spirit, Jason Sorens, Fait Muedini, and William Ruger introduced a free database that offered a comprehensive set of variables involving over 170 public policies at the state and local levels in order to \u201creduce reduplication of scholarly effort.\u201d The National Conference of State Legislatures<\/a> (NCSL) provides links to state legislatures, bill lists, constitutions, reports, and statutes for all fifty states. The State Legislative History Research Guides<\/a> compiled by the University of Indiana Law School also include links to legislative and historical resources for the states, such as the Legislative Reference Library of Texas<\/a>. However, to our knowledge, no existing resource assesses usability across all state websites.<\/p>\n

So, what did we find during our assessment of the state websites? In general, we observed that the archival records as well as the search and results functions leave considerable room for improvement. The maximum possible score was 11 in each year, and the average was 3.87 in 2008 and 4.25 in 2010. For researchers interested in certain time periods, policy areas, committees, or sponsors, the inability to set filters, immediately see relevant results, and access past legislative sessions limits their ability to complete projects in a timely manner (or at all). We also found a great deal of variation in site features, content, and navigation. Greater standardization would improve access to information about state policymaking by researchers and the general public\u2014although some legislators may well see benefits to opacity.<\/p>\n

While we noted some progress over the study period, not all change was positive. By 2010, two states had scored 10 points (no state scored the full 11), fewer states had very low scores, and the average score rose slightly from 3.87 to 4.25 (out of 11). This suggests slow but steady improvement, and the provision of a baseline of support for researchers. However, a quarter of the states showed score drops over the study period, for the most part reflecting the adoption of \u201cPowered by Google\u201d search tools that used only keywords, and some in a very limited manner. If the latter becomes a trend, we could see websites becoming less, not more, user friendly in the future.<\/p>\n

In addition, our index may serve as a proxy variable for state government transparency. While\u00a0 the website scores were not statistically associated with\u00a0Robert Erikson, Gerald Wright, and John McIver\u2019s measure of state ideology, there may nevertheless be promise for future research along these lines; additional transparency determinants worth testing include legislative professionalism and social capital. Moving forward, the states might consider creating a working group to share ideas and best practices, perhaps through an organization like the National Conference of State Legislatures, rather than the national government, as some states might resist leadership from D.C. on federalist grounds.<\/p>\n

Helen Margetts (2009) has noted<\/a> that \u201cThe Internet has the capacity to provide both too much (which poses challenges to analysis) and too little data (which requires innovation to fill the gaps).\u201d\u00a0It is notable, and sometimes frustrating, that state legislative websites illustrate both dynamics. As datasets come online at an increasing rate, it is also easy to forget that websites can vary in terms of user friendliness, hierarchical structure, search terms and functions, terminology, and navigability \u2014 causing unanticipated methodological and data capture problems (i.e. headaches) to scholars working in this area.<\/p>\n

\n

Read the full paper: Taofang Huang, David Leal, B.J. Lee, and Jill Strube (2012) Assessing the Online Legislative Resources of the American States<\/a>. Policy and Internet 4 (3-4).<\/p>\n","protected":false},"excerpt":{"rendered":"

Public demands for transparency in the political process have long been a central feature of American democracy, and recent technological improvements have considerably facilitated the ability of state governments to respond to such public pressures.\u00a0With online legislative archives, state legislatures can make available a large number of public documents. In addition to meeting the demands […]<\/p>\n","protected":false},"author":166,"featured_media":1339,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[9,11,14],"tags":[83],"_links":{"self":[{"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/posts\/654"}],"collection":[{"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/users\/166"}],"replies":[{"embeddable":true,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/comments?post=654"}],"version-history":[{"count":1,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/posts\/654\/revisions"}],"predecessor-version":[{"id":3771,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/posts\/654\/revisions\/3771"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/media\/1339"}],"wp:attachment":[{"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/media?parent=654"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/categories?post=654"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ensr.oii.ox.ac.uk\/wp-json\/wp\/v2\/tags?post=654"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}