Research · White paper · Draft 2.6 for review
The TPRAT white paper
Reliability and validity of the Townsend Personal and Relational Assessment Tool. © 2024 John Townsend, PhD, Townsend Leadership. Presented by Dr. Karen Bergstrom.
Abstract
The TPRAT (Townsend Personal and Relational Assessment Tool) measures four character capacities: Attachment, Separation, Integration and Adulthood. This paper reports a reliability and validity study of the instrument. A confirmatory factor analysis of responses from 1,145 participants, collected online from August 2022 to August 2023, supported the four-capacity structure and reduced the instrument from 64 items to 20, five per capacity. Scale reliabilities ranged from .75 to .80 (Cronbach’s alpha) and .75 to .81 (Raykov’s omega). Each capacity was then compared with established instruments measuring related constructs; the predicted relationships were mostly moderate to strong and in the expected direction.
Key findings
- 1,145 participants were included in all analyses, out of 1,470 who started; inclusion required completing 90% of required items.
- Confirmatory factor analysis reduced the instrument from 64 items to 20, five per capacity. 18 items were removed for complex loadings or highly correlated errors.
- Model fit: RMSEA .070 (90% CI .066 to .074), Comparative Fit Index .88, Tucker-Lewis Index .86.
- Reliability: Cronbach’s alpha .75 to .80 and Raykov’s omega .75 to .81 across the four scales. All scales were highly correlated with each other (r ≥ .44).
- Validation against six established instruments found mostly moderate to strong correlations in the expected direction for every capacity.
The four capacities
The theoretical base draws on neuroscience, object relations theory, cognitive behavioral theory, business and leadership research, and spiritual growth models. The TPRAT was created to measure a person’s proficiency in four domains:
- Attachment (live connected): Bonding and vulnerability in relationships. Creates the ability to receive and use the support, encouragement and feedback of significant others, to fuel life and function at high levels.
- Separation (live freely): Boundaries, self-definition and confronting well. Helps a person experience themselves as distinct from others, with their own voice, and interact with healthy boundaries.
- Integration (live balanced): Managing the positives and negatives of oneself and others. Creates the ability to deal successfully with failure, imperfection and loss.
- Adulthood (live purposefully): Clarity of purpose and a mutual orientation toward others in authority. Enables a person to determine their purpose and mission, and to function well in authority contexts such as work and organizations.
The instrument is intended for businesses, educational organizations, counseling groups and churches, for individuals, couples, groups and teams.
Method
The Townsend Group commissioned the study to streamline the instrument to fewer questions and to confirm its validity. The survey combined the 64 TPRAT items with 113 questions from six validated instruments, each matched to one or more capacities. It was built online with the support of Concordia College and fielded from August 2022 to August 2023. Items are answered on a six-point scale from 1, strongly disagree, to 6, strongly agree.
Participants
More than half of the 1,145 participants were 50 or older, and 85% held at least a bachelor’s degree or a professional or trade certification. 71% were female and 29% male; 70% were married and 77% had children. The sample included executives, small business owners, executive directors, HR professionals, pastors, therapists and educators.
| Age | Share |
|---|---|
| 18–24 | 2% |
| 24–30 | 6% |
| 30–40 | 14% |
| 40–50 | 24% |
| 50–65 | 38% |
| 65+ | 16% |
| Highest education | Share |
|---|---|
| Master’s degree | 45% |
| Bachelor’s degree | 29% |
| Doctorate | 8% |
| Some college | 7% |
| Associate’s degree | 5% |
| Professional or trade certification | 3% |
| High school diploma or GED | 3% |
| Less than high school | 1% |
Reliability by scale
| Scale | Cronbach α | Raykov ω |
|---|---|---|
| Adulthood | .75 | .77 |
| Attachment | .80 | .81 |
| Integration | .75 | .75 |
| Separation | .79 | .80 |
Final items and factor loadings
All loadings significant at p < .001.
Attachment
- I have difficulty telling others how much they really mean to me. (λ = .62, reverse coded)
- I find it difficult to be in touch with my deeper emotions. (λ = .67, reverse coded)
- It is difficult for me to ask for help or support from others. (λ = .62, reverse coded)
- I have a tough time talking about my feelings, even with those I am close to. (λ = .84, reverse coded)
- When I am in a small group, I tend to keep my vulnerable feelings to myself. (λ = .63, reverse coded)
Separation
- I can communicate what I want and do not want in my work and relationships. (λ = .67)
- When I disagree with someone, I prefer to remain silent. (λ = −.46)
- I put too much time and energy into people-pleasing. (λ = −.72, reverse coded)
- I have difficulty being clear on my own opinions and values when speaking to others. (λ = −.65)
- I avoid saying “no” so that I will not risk rejection or hurt someone’s feelings. (λ = −.76, reverse coded)
Integration
- I readily forgive others for their mistakes. (λ = .49)
- I know and accept my weaknesses. (λ = .53)
- When I fail, I am able to try again. (λ = .68)
- When I am disappointed by someone, I am still mindful of their good points at the same time. (λ = .61)
- When I fail, I can deal with the disappointment in a healthy way. (λ = .74)
Adulthood
- I am clear on my life’s mission and path. (λ = .71)
- I have struggled with finding my career niche. (λ = −.69, reverse coded)
- I am frustrated I have not sufficiently developed my potential. (λ = −.70, reverse coded)
- I usually confront those in authority in ways that are amicable for all. (λ = .44)
- I am comfortable relating to those in authority. (λ = .54)
Validation correlations
Pearson correlations with published instruments, read against Cohen’s thresholds: small .10, medium .30, large .50.
Attachment
- AAQ Avoidance: r = −.64
- AAQ Anxiety: r = −.24
Scored toward a secure style, Attachment correlated negatively with AAQ Avoidance and AAQ Anxiety, in the expected direction, though the relationship with Anxiety was weak.
Separation
- DSI Emotional Reactivity: r = .45
- DSI Fusion with Others: r = .45
- DSI I-Position: r = .28
- DSI Emotional Cutoff: r = .16
Moderately positive with Emotional Reactivity and Fusion with Others, and weakly positive with I-Position and Emotional Cutoff.
Integration
- AAG Resilient: r = .53
- Hypersensitive Narcissism: r = −.47
- AAG Overwhelmed: r = .33
- MPS Socially Prescribed: r = −.32
- MPS Self Oriented: r = −.22
- MPS Other Oriented: r = −.11
- AAG Controlled: r = .05
A moderate association with the Hypersensitive Narcissism Scale and with socially prescribed perfectionism, in the expected direction. Strong with AAG Resilient, moderate with AAG Overwhelmed, very weak with AAG Controlled.
Adulthood
- PERMA Overall Well-Being: r = .65
- PERMA Meaning: r = .64
- Rosenberg Self-Esteem: r = .64
- PERMA Accomplishment: r = .6
- PERMA Positive Emotions: r = .59
- PERMA Relationships: r = .46
- PERMA Negative Emotion: r = −.44
- PERMA Engagement: r = .43
- PERMA Loneliness: r = −.38
- PERMA Health: r = .32
Generally strong. Four of nine PERMA measures were strongly positive, the other five moderate, and Rosenberg Self-Esteem was also strongly positive. Negative Emotion and Loneliness ran in the expected direction.
What the analysis suggests
These results demonstrate validity of the 20-item TPRAT survey instrument. The predicted relationships between the TPRAT scales and the validation scales were mostly strong and in the expected direction. All four scales showed moderate to strong association with the corresponding validated scales in all, or almost all, instances. Cronbach and Raykov reliabilities were high for every scale. The confirmatory factor model fit the data, supporting the four-capacity structure, and the instrument was streamlined from 64 items to 20.
Appendix: the twenty items
| # | Item | Capacity |
|---|---|---|
| 1 | I usually confront those in authority in ways that are amicable for all. | Adulthood |
| 2 | When I fail, I can deal with the disappointment in a healthy way. | Integration |
| 3 | I can communicate what I want and do not want in my work and relationships. | Separation |
| 4 | I have struggled with finding my career niche. | Adulthood |
| 5 | When I disagree with someone, I prefer to remain silent. | Separation |
| 6 | I have difficulty telling others how much they really mean to me. | Attachment |
| 7 | I avoid saying “no” so that I will not risk rejection or hurt someone’s feelings. | Separation |
| 8 | I am comfortable relating to those in authority. | Adulthood |
| 9 | I find it difficult to be in touch with my deeper emotions. | Attachment |
| 10 | I am frustrated that I have not sufficiently developed my potential. | Adulthood |
| 11 | It is difficult for me to ask for help or support from others. | Attachment |
| 12 | I know and accept my weaknesses. | Integration |
| 13 | I have a tough time talking about my feelings, even with those I am close to. | Attachment |
| 14 | I readily forgive others for their mistakes. | Integration |
| 15 | I am clear on my life’s mission and path. | Adulthood |
| 16 | When I fail, I am able to try again. | Integration |
| 17 | When I am disappointed by someone, I am still mindful of their good points at the same time. | Integration |
| 18 | I put too much time and energy into people-pleasing. | Separation |
| 19 | I have difficulty being clear on my own opinions and values when speaking to others. | Separation |
| 20 | When I am in a small group, I tend to keep my vulnerable feelings to myself. | Attachment |
How to cite
Townsend, J. (2024). Reliability and validity of the Townsend Personal and Relational Assessment Tool (TPRAT), white paper draft 2.6. Townsend Leadership. Presented by K. Bergstrom at https://drkarenbergstrom.com/research/tprat-white-paper
References
- Alessandri, G., Vecchione, M., Eisenberg, N., and Łaguna, M. (2015). On the factor structure of the Rosenberg (1965) General Self-Esteem Scale. Psychological Assessment, 27(2), 621 to 635.
- Butler, J., and Kern, M. L. (2015). The PERMA-Profiler: A brief multidimensional measure of flourishing.
- Caligor, E., et al. (2018). Psychodynamic therapy for personality pathology: Treating self and interpersonal functioning. The American Journal of Psychiatry, 175(12), 1268 to 1269.
- Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
- Covey, S. (2018). The Seven Habits of Highly Effective People, 30th anniversary edition.
- Goleman, D., et al. (2013). Primal Leadership: Unleashing the Power of Emotional Intelligence. Harvard Business Review Press.
- Hendin, H. M., and Cheek, J. M. (1997). Assessing hypersensitive narcissism: A reexamination of Murray’s Narcissism Scale. Journal of Research in Personality, 31(4), 588 to 599.
- Hewitt, P. L., and Flett, G. L. (1990). Perfectionism and depression: A multidimensional analysis. Journal of Social Behavior and Personality, 5(5), 423 to 438.
- Lencioni, P. M. (2022). The 6 Types of Working Genius. BenBella Books.
- Machin, L. (2007). The Adult Attitude to Grief Scale as a tool of practice for counsellors working with bereaved people. Age Concern, Tameside and Keele University.
- Piedmont, R. L., et al. (1991). Adjective Check List scales and the five-factor model. Journal of Personality and Social Psychology, 60(4), 630 to 637.
- Simpson, J. A., Rholes, S. W., and Phillips, D. (1996). Conflict in close relationships: An attachment perspective. Journal of Personality and Social Psychology, 71, 899 to 914.
- Skowron, E. A., and Schmitt, T. A. (2003). Assessing interpersonal fusion: Reliability and validity of a new DSI fusion with others subscale. Journal of Marital and Family Therapy, 29(2), 209 to 222.