Construct and Concurrent Validity of two Scales Designed to Measure Reinforcement Sensitivity

Main Article Content

Marco Pulido
Tania Aristegui
Andrea Gutiérrez
Victoria Mariñelarena
Fernanda Parra
Mariana Pascual

Abstract

Two studies assessed construct and concurrent validity of two scales designed to measure reinforcement sensitivity. Two non-probabilistic samples of college students from Mexico City were used. The first study showed that while the BIS/BAS scales may possess construct validity, they lack in concurrent one; conversely, the SPSRQ did not show construct validity but showed evidence of concurrent one. Convergent validity was assessed using self-report questionnaires. The second study showed that the BAS scales may predict response distribution, in the IOWA-GT, in a way that is consistent with Reinforcement Sensitivity Theory (RST); this was not the case with the BIS scale. The results suggest that either the scales developed to assess RST, or the theory itself (or both) require a thorough revision.  

Article Details

How to Cite
Construct and Concurrent Validity of two Scales Designed to Measure Reinforcement Sensitivity . (2023). Argentinean Journal of Behavioral Sciences, 15(1), 93-106. https://doi.org/10.32348/1852.4206.v15.n1.30901
Section
Original Articles

How to Cite

Construct and Concurrent Validity of two Scales Designed to Measure Reinforcement Sensitivity . (2023). Argentinean Journal of Behavioral Sciences, 15(1), 93-106. https://doi.org/10.32348/1852.4206.v15.n1.30901

References

Adrián-Ventura, J., Costumero, V., Parcet, M.A. & Ávila, C. (2019). Linking personality and brain anatomy: a structural MRI approach to Reinforcement Sensitivity Theory. Social Cognitive and Affective Neuroscience,14(3), 329-338. doi: 10.1093/scan/nsz011.

Baggio S., Dupuis M., Iglesias K., & Daeppen J. B. (2015). Independent and combined associations of risky single-occasion drinking and drinking volume with alcohol use disorder: evidence from a sample of young Swiss men. Drug and Alcohol Dependence, 154, 260-263. doi: 10.1016/j.drugalcdep.2015.07.008

Barranco Jiménez, L., Rodarte Acosta, B., Medina Cuevas, Y. & Solís-Cámara Reséndiz, P. (2009). Evaluación psicométrica de los sistemas de activación e inhibición del comportamiento en adultos mexicanos. Anales de Psicología, 25(2), 358-367.

Baum, W. M., & Aparicio, C. F. (1999). Optimality and concurrent variable‐interval variable-ratio schedules. Journal of the Experimental Analysis of Behavior, 71(1), 75-89. doi: 10.1901/jeab.1999.71-75

Bechara, A., Damasio, A. R., Damasio, H. & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50(1-3), 7-15. doi: 10.1016/0010-0277(94)90018-3

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. doi: 10.1037/0033-2909.107.2.238

Bentler, P. M. (2005). EQS 6 structural equations program manual. Encino, CA: Multivariate Software.

Borrero, C. S., Vollmer, T. R., Borrero, J. C., Bourret, J. C., Sloman, K. N., Samaha, A. L., & Dallery, J. (2010). Concurrent Reinforcement Schedules for Problem Behavior and Appropriate Behavior: Experimental Applications of the Matching Law. Journal of the Experimental Analysis of Behavior, 93(3), 455–469. doi: 10.1901/jeab.2010.93-455

Bozarth, M. A. (1991). The mesolimbic dopamine system as a model reward system. In P. Willner, & J. Scheel-Krüger (Eds.), The mesolimbic dopamine system: From motivation to action (pp. 301–330). London: John Wiley & Sons.

Caci, H., Deschaux, O., & Baylé, F. J. (2007). Psychometric properties of the French versions of the BIS/BAS scales and the SPSRQ. Personality and Individual Differences, 42(6), 987-998. doi: 10.1016/j.paid.2006.09.008

Carver, S. C., & White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS scales. Journal of Personality and Social Psychology, 67(2), 319-333. doi: 10.1037/0022-3514.67.2.319

Cloninger, C. R. (1987). A systematic method for clinical description and classification of personality variants. Archives of General Psychiatry, 44(6), 573-588. doi: 10.1001/archpsyc.1987.01800180093014

Cogswell, A., Alloy, L. B., van Dulmen, M. H. M., & Fresco, D. M. (2006). A psychometric evaluation of behavioral inhibition and approach self-report measures. Personality and Individual Differences, 40(8), 1649-1658. doi: 10.1016/j.paid.2005.12.008

Corr, P. J. (2016). Reinforcement Sensitivity Theory of Personality Questionnaires: Structural survey with recommendations. Personality and Individual Differences, 89, 60–64. doi: 10.1016/j.paid.2015.09.045

Corr, P. J., & Cooper, A. J. (2016). The Reinforcement Sensitivity Theory of Personality Questionnaire (RST-PQ): Development and validation. Psychological Assessment, 28(11), 1427–1440. doi: 10.1037/pas0000273

Corr, P. J. & McNaughton, N. (2015). Neural mechanisms of low trait anxiety and risk for externalizing behaviour. In T. Beauchaine & S. Hinshaw (eds.), Oxford Handbook of Externalizing Spectrum Disorders: A Developmental Psychopathology Perspective (pp. 220-238). Oxford: Oxford University Press

Dawe, S., Gullo, M. J., & Loxton, N.J. (2004). Reward drive and rash impulsiveness as dimensions of impulsivity: Implications for substance misuse. Addictive Behaviors, 29(7), 1389-1405. doi: 10.1016/j.addbeh.2004.06.004

Demianczyk, A. C., Jenkins, A. L., Henson, J. M., & Conner, B. T. (2014). Psychometric evaluation and revision of Carver and White’s BIS/BAS scales in a diverse sample of young adults. Journal of Personality Assessment, 96(5), 485-494. doi. 10.1080/00223891.2013.870570

Dufey, M., Fernández, A. M., & Morgues, C. (2011). Assessment of the behavioral –inhibition system and the behavioral approach system: Adaptation and validation of the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) in a Chilean sample. The Spanish Journal of Psychology, 14(1), 432–440. doi: 10.5209/revSJOP.2011.v14.n1.39

Eysenck, H.J. (1957). The dynamics of anxiety and hysteria. New York, Preger.

Flora, D. B., & Curran, P. J. (2004). An Empirical Evaluation of Alternative Methods of Estimation for Confirmatory Factor Analysis With Ordinal Data. Psychological Methods, 9(4), 466–491. doi: 10.1037/1082-989X.9.4.466

Folino, J. O., Escobar Córdoba, F., & Castillo, J.L. (2006). Exploración de la validez de la escala de impulsividad de Barratt (Bis-11) en la población carcelaria argentina. Revista Colombiana de Psiquiatría, 35(2), 132-148.

Franken, I. H. A., Muris, P., & Rassin, E. (2005). Psychometric properties of the Dutch BIS/BAS scales. Journal of Psychopathology and Behavioral Assessment, 27(1), 25-30. doi: 10.1007/s10862-005-3262-2

Gray, J. A. (1970). The psychophysiological basis of introversion-extraversion. Behavior Research and Therapy, 8(3), 249-266. doi: 10.1016/0005-7967(70)90069-0

Gray, J. A. (1972). The psychophysiological basis of introversion-extraversion: A modification of Eysenck’s theory. In V. D. Nebylitsyn & J. A. Gray (Eds.), The biological bases of individual behavior (pp. 182-205). San Diego, CA: Academic Press. doi: 10.1016/b978-0-12-515350-8.50017-x

Gray, J. A. (1975). Elements of a two-process theory of learning. London, Academic Press.

Gray, J. A. (1976). The behavioural inhibition system: A possible substrate for anxiety. In M. P. Feldman & A. M. Broadhurst (Eds.), Theoretical and Experimental Bases of Behaviour Modification. London: Wiley.

Gray, J. A. (1977). Drug effects on fear and frustration: Possible limbic site of action of minor tranquilizers. In L. L. Iversen, S. D. Iversen & S. H. Snyder (Eds.), Handbook of psychopharmacology (pp. 433-529). New York, Plenum.

Gray, J. A. (1981). A critique of Eysenck´s theory of personality. In H. J. Eysenck (Ed.), A model for personality (pp. 246-276). Berlin: Springer-Verlag. doi: 10.1017/s0141347300009599

Gray, J. A. (1982). The neuropsychology of anxiety: an enquiry into the functions of the septo- hippocampal system. Oxford, USA: Oxford University Press.

Gray, J. A. (1987). The psychology of fear and stress. London: Cambridge University Press.

Gray, J. A., & McNaughton, N. (1996). The neuropsychology of anxiety: Reprise. Nebraska Symposium on Motivation, 43, 61–134.

Gray, J. A., & McNaughton, N. (2000). The neuropsychology of anxiety: an enquiry into the functions of the septo-hippocampal system (2nd.ed.). New York, NY: Oxford University Press.

Gray, J. D., Hanna, D., Gillen, A., & Rushe, T. (2016). A closer look at Carver and White's BIS/BAS scales: Factor analysis and age group differences. Personality and Individual Differences, 95, 20–24. doi: 101.1016/j.paid.2016.02.022

Hahn, T., Dresler, T., Plichta, M. M., Ehlis, A.C., Ernst, L. H., Markulin, F., … Fallgatter A. J. (2010). Functional amygdala-hippocampus connectivity during anticipation of aversive events is associated with Gray's trait "sensitivity to punishment". Biological Psychiatry, 68(5), 459-464. doi: 10.1016/j.biopsych.2010.04.033.

Heubeck, B. G., Wilkinson, R. B., & Cologon, J. (1998). A second look at Carver and White’s (1994) BIS/BAS scales. Personality and Individual Differences, 25(4), 785-800. doi: 10.1016/S0191-8869(98)00124-X

Heym, N., Ferguson, E., & Lawrence, C. (2008). An evaluation of the relationship between Gray’s revised RST and Eysenck’s PEN: distinguishing BIS and FFFS in Carver and White’s BIS/BAS scales. Personality and Individual Differences, 45(8), 709-715. doi: 10.1016/j.paid.2008.07.013

Jorm, A. F., Christensen, H., Henderson, A. S., Jacomb, P. A., Korten, A. E., & Rodgers, B. (1998). Using the BIS/BAS Scales to measure behavioural inhibition and behavioural activation: factor structure, validity and norms in a large community sample. Personality and Individual Differences, 26(1), 49-58. doi: 10.1016/S0191-8869(98)00143-3

Kim, D. Y., & Lee, J. H. (2011). Effects of the BAS and BIS on decision-making in a gambling task. Personality and Individual Differences, 50(7), 1131–1135. doi: 10.1016/j.paid.2011.01.041

Lardi, C., Billieux, J., d'Acremont, M., & Van der Linden, M. (2008). A French adaptation of a short version of the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ). Personality and Individual Differences, 45(8), 722-725. doi: 10.1016/j.paid.2008.07.019

Leone, L., Perugini, M., Bagozzi, R. P., Pierro, A., & Mannetti, L. (2001). Construct validity and generalizability of the Carver-White behavioural inhibition system/behavioural activation system scales. European Journal of Personality, 15(5), 373-390. doi: 10.1002/per.415

Katz, B. A., Matanky, K., Aviram, G., & Yovel, I. (2020). Reinforcement sensitivity, depression and anxiety: A meta-analysis and meta-analytic structural equation model. Clinical Psychology Review, 77, 101842. doi: 10.1016/j.cpr.2020.101842.

Maack, D. J., & Ebesutani, C. (2018). A re-examination of the BIS/BAS scales: Evidence for BIS and BAS as unidimensional scales. International Journal of Methods in Psychiatric Research, 27(2), e1612. doi: 10.1002/mpr.1612

MacAndrew, C., & Steele, T. (1991). Gray’s behavioral inhibition system: A psychometric evaluation. Personality and Individual Differences, 12(2), 157-171. doi: 10.1016/0191-8869(91)90099-W

Mechelmans, D. J., Strelchuk, D., Doñamayor, N., Banca, P., Robbins, T. W., Baek, K., & Voon, V. (2017). Reward Sensitivity and Waiting Impulsivity: Shift towards Reward Valuation away from Action Control. International Journal of Neuropsychopharmacolgy, 20(12), 971-978. doi: 10.1093/ijnp/pyx072.

Moreira, D., Almeida, F., Pinto, M., Segarra, P., & Barbosa, F. (2015). Data concerning the psychometric properties of the behavioral inhibition/behavior activation scales for the Portuguese population. Psychological Assessment, 27(3), 1117-1122. doi. 10.1037/pas0000108

Müller, J. M., & Wytykowska, A. M. (2005). Psychometric properties and validation of a Polish adaptation of Carver and White’s BIS/BAS scales. Personality and Individual Differences, 39(4), 795-805. doi. 10.1016/j.paid.2005.03.006

O’Connor, R. M., Colder, C. R., & Hawk, L. W. (2004). Confirmatory factor analysis of the Sensitivity to Punishment and Sensitivity to Reward Questionnaire. Personality and Individual Differences, 37(5), 985-1002. doi: 10.1016/j.paid.2003.11.008

Overman, W. H., & Pierce, A. (2013). Iowa Gambling Task with non-clinical participants: effects of using real + virtual cards and additional trials. Frontiers in Psychology, 4, 935. doi: 10.3389/fpsyg.2013.00935

Patton, J. H., Stanford, M. S., & Barratt, E. S. (1995). Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology, 51(6), 768-774. doi: 10.1002/1097-679(199511)51:63.0.CO;2-1

Pickering, A., & Corr, P. (2008). J. A. Gray’s reinforcement sensitivity theory (RST) of personality. In: G. Boyle, G. Matthews & D. Saklofske, (Eds.), The SAGE Handbook of Personality: Theory and Assessment Personality Measurement and Testing (pp. 239-255). London, New Delhi and Thousand Oaks: Sage.

Pickering, A., & Gray, J. A. (1999). The neuroscience of personality. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (pp. 277–299). Nueva York: Guilford Press.

Pickering, A., & Gray, J. A. (2001). Dopamine, appetitive reinforcement, and the neuropsychology of human learning: An individual differences approach. In A. Eliasz & A. Angleitner (Eds), Advances in Research on Temperament (pp. 113-149). Germany: PABST Science Publishers Lengerich.

Potts, G. F., George, M. R., Martin, L. E., & Barratt E. S. (2006). Reduced punishment sensitivity in neural systems of behavior monitoring in impulsive individuals. Neuroscience Letters, 397(1-2), 130-134. doi: 10.1016/j.neulet.2005.12.003.

Poythress, N. G., Edens, J. F., Landfield, K., Lilienfeld, S. O., Skeem, J. L., & Douglas K. S. (2008). A critique of behavioral inhibition scale (BIS) for investigating theory of primary psychopathy. Personality and Individual Differences, 45(4), 269–275. doi: 10.1016/jpaid.2008.04.014

Pulido, M., Rivera, L., Fondón, A., & Vázquez, P. (2016). Propiedades psicométricas de la Escala BIS/BAS en una muestra de estudiantes universitarios mexicanos. Enseñanza e Investigación en Psicología, 21(3), 300-310.

Pulido, M., Hernández, A. M., Irecta, C., Reynoso, M., Silos, M. J., Valdés, D., Valenzuela, M., Valdez, D. & Rivera, L. (2016). Comorbilidad entre alcohol, tabaco y adicción a las nuevas tecnologías de la información: Evaluación del modelo BIS/BAS. Revista Mexicana de Investigación en Psicología, 8(1), 19-35.

Ross, S. R., Millis, S. R., Bonebright, T. L., & Bailley, S. E. (2002). Confirmatory factor analysis of the behavioral inhibition and activation scales. Personality and Individual Differences, 33(6), 861-865. doi: 10.1016/S0191-8869(01)00196-9

Salvo, G.L. & Castro, S.A. (2013). Confiabilidad y validez de la escala de impulsividad de Barratt (Bis-11) en adolescentes. Revista Chilena de Neuropsiquiatría, 51(4), 245-254. doi: 10.4067/S0717-92272013000400003.

Sava, F. & Sperneac, A-M. (2006). Sensitivity to Reward and Sensitivity to Punishment rating scales: a validation study on the Romanian population. Personality and Individual Differences, 41(8), 1445-1456. doi: 10.1016/j.paid.2006.04.024

Smillie, L. D. (2008). What is reinforcement sensitivity? Neuroscience paradigms for approach-avoidance process theories of personality. European Journal of Personality, 22(5), 359–384. doi: 10.1002/per.674

Steiger, J. H. (1990). Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivariate Behavioral Research, 25(2), 173-180. doi: 10.1207/s15327906mbr2502_4

Steingroever, H., Wetzels, R., Horstmann, A., Neumann, J., & Wagenmakers, E. J. (2013). Performance of healthy participants on the Iowa Gambling Task. Psychological Assessment, 25(1), 180-193. doi: 10.1037/a0029929

Stellar, J. R. & Stellar, E. (1985). The neurobiology of motivation and reward. New York: Springer-Verlag.

Suhr, J., & Tsanadis, J. (2007). Affect and Personality Correlates of the Iowa Gambling Task. Personality and Individual Differences, 43(1), 27-36. doi: 10.1016/j.paid.2006.11.004

Tafoya Ramos, R., Gómez Pérez Mitre, P., Ortega Soto, S., & Ortiz León, S. (2006). Inventario de Ansiedad de Beck: Validez y confiabilidad en estudiantes que solicitan atención psiquiátrica en la UNAM. Psiquis, 15(3), 82-87.

Thompson, G. H. (1951) The factorial analysis of human ability. London: University of London Press.

Torrubia, R., Ávila, C., Moltó, J., & Caseras, X. (2001). The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) as a measure of Gray’s anxiety and impulsive dimensions. Personality and Individual Differences, 31(6), 837-862. doi: 10.1016/S0191-8869(00)00183-5

Torrubia, R., & Tobena, A. (1984). A scale for the assessment of ´susceptibility to punishment´ as a measure of anxiety: Preliminary results. Personality and Individual Differences, 5(3), 371-375. doi: 10.1016/0191-8869(84)90078-3

van Honk, J., Hermans, E. J., Putman, P., Montagne, B., & Schutter, D. J. (2002). Defective somatic markers in sub-clinical psychopathy. Neuroscience Research, 13(8), 1025-1027. doi: 10.1097/00001756-200206120-00009

Waller, N.G., Lilienfeld, S.O. Tellegen, A. & Lykken, D.T. (1991). The Tridimensional Personality Questionnaire: Structural validity and comparisons with the Multidimensional Personality Questionnaire. Multivariate Behavioral Research, 26(1), 1-23. doi: 10.1207/s15327906mbr2601_1

Wilbertz, G., van Elst L. T., Delgado, M. R., Maier, S., Feige, B., Philipsen, A., & Blechert, J. (2012). Orbitofrontal reward sensitivity and impulsivity in adult attention deficit hyperactivity disorder. Neuroimage, 60(1), 353-361. doi: 10.1016/j.neuroimage.2011.12.011

Wilson, G. D., Gray, J. A., & Barrett, P. T. (1990). A factor analysis of the Gray-Wilson personality questionnaire. Personality and Individual Differences, 11(10), 1037-1045. doi: 10.1016/0191-8869(90)90131-A