Pub Date : 2023-08-20DOI: 10.1177/1525822x231195726
Jamelia Harris
Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4) reconfirm using focus group discussions.
{"title":"Estimating the Size of the Target Population in Data Limited Settings","authors":"Jamelia Harris","doi":"10.1177/1525822x231195726","DOIUrl":"https://doi.org/10.1177/1525822x231195726","url":null,"abstract":"Not knowing the population size is a common problem in data-limited contexts. Drawing on work in Sierra Leone, this short take outlines a four-step solution to this problem: (1) estimate the population size using expert interviews; (2) verify estimates using interviews with participants sampled; (3) triangulate using secondary data; and (4) reconfirm using focus group discussions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42017159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-17DOI: 10.1177/1525822x231194178
P. Jabkowski, A. Piekut
This study analyzes the consequences of item nonresponse to the question about a household’s total net income in the European Social Survey (2008–2018). We recognize two mechanisms in avoiding answering the income question: task complexity and question sensitivity, and apply multilevel logistic regressions to predict the probability of refusals or “Do not know” across respondents of different income levels. We find that the refusal to answer the income question is the highest for respondents with lower incomes, while the probability of selecting “Do not know” answers or refusal to answer is the same among respondents with higher incomes. The bias resulting from the correlation between response propensities and household income affects the accuracy of estimates for several attitudinal measures when income is included as an explanatory variable. We recommend reducing the risk of bias by limiting the complexity and sensitivity of the income question and accounting for nonresponse bias.
{"title":"Not Random and Not Ignorable. An Examination of Nonresponse to Income Question in the European Social Survey, 2008–2018","authors":"P. Jabkowski, A. Piekut","doi":"10.1177/1525822x231194178","DOIUrl":"https://doi.org/10.1177/1525822x231194178","url":null,"abstract":"This study analyzes the consequences of item nonresponse to the question about a household’s total net income in the European Social Survey (2008–2018). We recognize two mechanisms in avoiding answering the income question: task complexity and question sensitivity, and apply multilevel logistic regressions to predict the probability of refusals or “Do not know” across respondents of different income levels. We find that the refusal to answer the income question is the highest for respondents with lower incomes, while the probability of selecting “Do not know” answers or refusal to answer is the same among respondents with higher incomes. The bias resulting from the correlation between response propensities and household income affects the accuracy of estimates for several attitudinal measures when income is included as an explanatory variable. We recommend reducing the risk of bias by limiting the complexity and sensitivity of the income question and accounting for nonresponse bias.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48865137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-16DOI: 10.1177/1525822x231195525
P. Premkumar, S. Ganesan, Balaji Pandiyan, Dhivyatharani Krishnamoorthy, G. Kang
Household expenditure data is at the core of efforts to measure living standards, inequality and financial protection against illness. Currently it is mainly derived from recall-based surveys that are time consuming and prone to measurement errors. Diaries are often used as an alternative approach, however this results in fatigue and low compliance. Smartphone- based diaries could overcome many of these challenges, but it is yet unknown how this approach could be used and its relationship with data from the household surveys. This study evaluated a smartphone-based diary application for collecting daily household expenditures and compared data with that of household surveys. Results show that smartphone-based diary applications could be used to optimize or complement the information from conventional survey-based indicators.
{"title":"Smartphone Diary Application in Household Surveys: Integration of High Frequency Temporal Data in Large-scale Data Collection","authors":"P. Premkumar, S. Ganesan, Balaji Pandiyan, Dhivyatharani Krishnamoorthy, G. Kang","doi":"10.1177/1525822x231195525","DOIUrl":"https://doi.org/10.1177/1525822x231195525","url":null,"abstract":"Household expenditure data is at the core of efforts to measure living standards, inequality and financial protection against illness. Currently it is mainly derived from recall-based surveys that are time consuming and prone to measurement errors. Diaries are often used as an alternative approach, however this results in fatigue and low compliance. Smartphone- based diaries could overcome many of these challenges, but it is yet unknown how this approach could be used and its relationship with data from the household surveys. This study evaluated a smartphone-based diary application for collecting daily household expenditures and compared data with that of household surveys. Results show that smartphone-based diary applications could be used to optimize or complement the information from conventional survey-based indicators.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48645410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-15DOI: 10.1177/1525822x231195521
M. Angrisani, A. Kapteyn, Swaroop Samek
From September 2016 to September 2018, we piloted the collection of financial transaction and account balance data in the Understanding America Study (UAS), a probability-based Internet panel representative of the U.S. adult population. Unlike previous studies relying on electronic transaction information from financial aggregators, which typically contain very little information on consumer characteristics, our data allow us to explore heterogeneity in consumer behavior as driven by demographics, cognitive ability, and financial literacy, among others. In this article, we describe the results of this pilot project, documenting selectivity issues and the major barriers associated with participation in the study. We carry out illustrative exercises to highlight how the combination of surveys and electronic financial records can lead to methodological advances in the measurement of individuals’ spending and saving behavior.
{"title":"Real Time Measurement of Household Financial Electronic Transactions in a Population Representative Panel: A Pilot Study","authors":"M. Angrisani, A. Kapteyn, Swaroop Samek","doi":"10.1177/1525822x231195521","DOIUrl":"https://doi.org/10.1177/1525822x231195521","url":null,"abstract":"From September 2016 to September 2018, we piloted the collection of financial transaction and account balance data in the Understanding America Study (UAS), a probability-based Internet panel representative of the U.S. adult population. Unlike previous studies relying on electronic transaction information from financial aggregators, which typically contain very little information on consumer characteristics, our data allow us to explore heterogeneity in consumer behavior as driven by demographics, cognitive ability, and financial literacy, among others. In this article, we describe the results of this pilot project, documenting selectivity issues and the major barriers associated with participation in the study. We carry out illustrative exercises to highlight how the combination of surveys and electronic financial records can lead to methodological advances in the measurement of individuals’ spending and saving behavior.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46135903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-09DOI: 10.1177/1525822x231194515
Anthony Distefano, Joshua S. Yang
Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs—such as ethnographic studies—have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and interviews. The three-phase method includes a priori sample size prediction, provisional saturation estimation during data collection, and post hoc confirmation. Post hoc analysis indicated we reached key thresholds of data saturation before ending fieldwork. We achieved 80% saturation at our 69th data collection event (63% of the full sample) and 90% saturation at our 91st data collection event (83% of the full sample). The method is designed to account for on-the-ground realities confronted in contemporary ethnographic research, including time constraints during fieldwork, and can accommodate studies with medium to large scopes, broad foci, heterogeneous populations, and analysis of multiple qualitative data sources.
{"title":"Sample Size and Saturation: A Three-phase Method for Ethnographic Research with Multiple Qualitative Data Sources","authors":"Anthony Distefano, Joshua S. Yang","doi":"10.1177/1525822x231194515","DOIUrl":"https://doi.org/10.1177/1525822x231194515","url":null,"abstract":"Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs—such as ethnographic studies—have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and interviews. The three-phase method includes a priori sample size prediction, provisional saturation estimation during data collection, and post hoc confirmation. Post hoc analysis indicated we reached key thresholds of data saturation before ending fieldwork. We achieved 80% saturation at our 69th data collection event (63% of the full sample) and 90% saturation at our 91st data collection event (83% of the full sample). The method is designed to account for on-the-ground realities confronted in contemporary ethnographic research, including time constraints during fieldwork, and can accommodate studies with medium to large scopes, broad foci, heterogeneous populations, and analysis of multiple qualitative data sources.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48348844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-16DOI: 10.1177/1525822x231188593
H. Einarsson, A. Cernat, N. Shlomo
The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or electoral district), affect participation rates in the 2021 Icelandic National Election Study, a mixed-mode cross-sectional survey. We find that these features generally fail to affect response propensities and sample composition. However, framed requests produced marginally higher response rates for a subset of the sample that was invited to complete the survey online. This suggests that modifying the presentation of the survey request may be less effective in cross-sectional surveys than in longitudinal ones, where more information is available to inform the content of targeted messages.
{"title":"The Effects of Framing the Survey Request and Using Targeted Appeals on Participation in Cross-sectional Surveys","authors":"H. Einarsson, A. Cernat, N. Shlomo","doi":"10.1177/1525822x231188593","DOIUrl":"https://doi.org/10.1177/1525822x231188593","url":null,"abstract":"The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or electoral district), affect participation rates in the 2021 Icelandic National Election Study, a mixed-mode cross-sectional survey. We find that these features generally fail to affect response propensities and sample composition. However, framed requests produced marginally higher response rates for a subset of the sample that was invited to complete the survey online. This suggests that modifying the presentation of the survey request may be less effective in cross-sectional surveys than in longitudinal ones, where more information is available to inform the content of targeted messages.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45783304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-30DOI: 10.1177/1525822x231176167
Tamara Holmes
This short take presents the process of a learning circle, underpinned by Dadirri (Ungunmeer-Baumann 1988). This method was used for the purposes of critical reflective practice and data collection activity with non-Indigenous participants. Dadirri is a First Nations (Australian) term for “deep listening.” The learning circle research occurred with social and welfare workers in a regional health service. We found, through privileging Indigenous knowledges in the activity, that this method can enable a generation of learnings and critical reflection and assist workers to apply theory to practice. This method can also be used as a data collection tool to evaluate these aims.
{"title":"Learning Circles, Underpinned by Dadirri","authors":"Tamara Holmes","doi":"10.1177/1525822x231176167","DOIUrl":"https://doi.org/10.1177/1525822x231176167","url":null,"abstract":"This short take presents the process of a learning circle, underpinned by Dadirri (Ungunmeer-Baumann 1988). This method was used for the purposes of critical reflective practice and data collection activity with non-Indigenous participants. Dadirri is a First Nations (Australian) term for “deep listening.” The learning circle research occurred with social and welfare workers in a regional health service. We found, through privileging Indigenous knowledges in the activity, that this method can enable a generation of learnings and critical reflection and assist workers to apply theory to practice. This method can also be used as a data collection tool to evaluate these aims.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"129 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135642601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-25DOI: 10.1177/1525822x231176693
Laura Kawerau, A. Birkenberg, T. Daum, Cosmas Alfred Butele, R. Birner
Agricultural studies mainly rely on quantitative research approaches. Despite growing interest in and uptake of qualitative, participatory, and visual methods due to their perceived advantages in gathering in-depth information and empowering participants, visual–digital research methods have yet to be largely applied. In our study on adaptation strategies to climate change among smallholder farmers in Uganda we compared different data collection methods, including: semi-structured interviews with manual note-taking, participatory impact diagrams, and adapted photovoice and cellphilm methodologies.
{"title":"Entering the Digital Research Age: Investigating the Effectiveness of Visual Digital Tools in Agricultural Research","authors":"Laura Kawerau, A. Birkenberg, T. Daum, Cosmas Alfred Butele, R. Birner","doi":"10.1177/1525822x231176693","DOIUrl":"https://doi.org/10.1177/1525822x231176693","url":null,"abstract":"Agricultural studies mainly rely on quantitative research approaches. Despite growing interest in and uptake of qualitative, participatory, and visual methods due to their perceived advantages in gathering in-depth information and empowering participants, visual–digital research methods have yet to be largely applied. In our study on adaptation strategies to climate change among smallholder farmers in Uganda we compared different data collection methods, including: semi-structured interviews with manual note-taking, participatory impact diagrams, and adapted photovoice and cellphilm methodologies.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48032868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-24DOI: 10.1177/1525822x231173805
D. Garbarski, Jennifer Dykema, Cameron P. Jones, Tiffany S. Neman, N. C. Schaeffer, Dorothy Farrar Edwards
Ethnoracial identity refers to the racial and ethnic categories that people use to classify themselves and others. How it is measured in surveys has implications for understanding inequalities. Yet how people self-identify may not conform to the categories standardized survey questions use to measure ethnicity and race, leading to potential measurement error. In interviewer-administered surveys, answers to survey questions are achieved through interviewer–respondent interaction. An analysis of interviewer–respondent interaction can illuminate whether, when, how, and why respondents experience problems with questions. In this study, we examine how indicators of interviewer–respondent interactional problems vary across ethnoracial groups when respondents answer questions about ethnicity and race. Further, we explore how interviewers respond in the presence of these interactional problems. Data are provided by the 2013–2014 Voices Heard Survey, a computer-assisted telephone survey designed to measure perceptions of participating in medical research among an ethnoracially diverse sample of respondents.
{"title":"Questioning Identity: How a Diverse Set of Respondents Answer Standard Questions About Ethnicity and Race","authors":"D. Garbarski, Jennifer Dykema, Cameron P. Jones, Tiffany S. Neman, N. C. Schaeffer, Dorothy Farrar Edwards","doi":"10.1177/1525822x231173805","DOIUrl":"https://doi.org/10.1177/1525822x231173805","url":null,"abstract":"Ethnoracial identity refers to the racial and ethnic categories that people use to classify themselves and others. How it is measured in surveys has implications for understanding inequalities. Yet how people self-identify may not conform to the categories standardized survey questions use to measure ethnicity and race, leading to potential measurement error. In interviewer-administered surveys, answers to survey questions are achieved through interviewer–respondent interaction. An analysis of interviewer–respondent interaction can illuminate whether, when, how, and why respondents experience problems with questions. In this study, we examine how indicators of interviewer–respondent interactional problems vary across ethnoracial groups when respondents answer questions about ethnicity and race. Further, we explore how interviewers respond in the presence of these interactional problems. Data are provided by the 2013–2014 Voices Heard Survey, a computer-assisted telephone survey designed to measure perceptions of participating in medical research among an ethnoracially diverse sample of respondents.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43692613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-05-21DOI: 10.1177/1525822x231173815
Kali Defever, Becky Reimer, Michael Trierweiler, Elise Comperchio
Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current Beneficiary Survey (MCBS) and administrative data from the Centers for Medicare and Medicaid Services (CMS). First, we investigate improvements from a prescription medicine lookup (PMLU) tool integrating a commercial medicine database into the MCBS. We then examine impacts of matching survey-reported medicines to Part D claims. We find that the PMLU improves accuracy and reduces measurement bias. Claims matching identifies additional medicines, especially for beneficiaries with more chronic conditions and medicines. This study shows that integrating a commercial database and supplementing with administrative data improves data quality and reduces sources of error.
{"title":"Improving Self-reported Prescription Medicine Data Quality with a Commercial Database Lookup Tool and Claims Matching","authors":"Kali Defever, Becky Reimer, Michael Trierweiler, Elise Comperchio","doi":"10.1177/1525822x231173815","DOIUrl":"https://doi.org/10.1177/1525822x231173815","url":null,"abstract":"Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current Beneficiary Survey (MCBS) and administrative data from the Centers for Medicare and Medicaid Services (CMS). First, we investigate improvements from a prescription medicine lookup (PMLU) tool integrating a commercial medicine database into the MCBS. We then examine impacts of matching survey-reported medicines to Part D claims. We find that the PMLU improves accuracy and reduces measurement bias. Claims matching identifies additional medicines, especially for beneficiaries with more chronic conditions and medicines. This study shows that integrating a commercial database and supplementing with administrative data improves data quality and reduces sources of error.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44191762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：