Ravi, this is phenomenal! Thanks for taking the time to formulate these questions and champion the survey, this is a great place to build from.
Here’s some of the things I’ve learned from some research about formulating surveys:
- Identify the answers we’re looking for and develop questions out of those. This helps make sure the data and questions will be relevant.
- Be simple, direct, and specific. Use language that has as little room for interpretation as possible, and is clearly and widely understood.
- Ask only one thing at a time. Break up more complex questions into multiple smaller, more direct questions.
- Keep questions as neutral as possible to avoid “leading questions”.
- Use interval questions to get nuanced data (1-5 scale).
- Use more “extreme” language to get more potent answers, like “most”, “worst”, “biggest”, etc.
So what is the data we’re trying to get? We want to know whether people: know what’s expected of them, have the resources they need to engage, feel supported by and engaged with the community, have the opportunity to do what excites them, feel like they belong here. (Loosely tied to the mountain climbing onboarding philosophy.)
Here is my reworking of the survey based on your original questions and the things I learned from my research, mixed with my current working onboarding philosophy:
Please answer these questions honestly in regards to your experience. The feedback will help us to improve our community operations. Thanks!
User Profile
- What is your expertise as a contributor?
- What part of SourceCred do you find the most engaging?
- When did you get involved in SourceCred? (less than a month ago, within the last 6 months, within the last year, more than a year ago.)
- How often do you engage with the project right now? (1 basically never, 2 rarely, 3 check in from time to time, 4 frequently around, 5 can’t stay away)
- In what ways do you engage with SourceCred? Choose all that apply: wallflower, text conversations in Discord, attending calls, posting thoughts in Discourse, working on a project/initiative, leading a team/championing an initiative, piece-meal work on my own, other _____.
- How connected do you feel to the vision of SourceCred? (1 not at all, 2 I’ve got other priorities here, 3 it resonates, 4 it really excites me, 5 it’s what I’m ABOUT)
Expectations
- I have at least a basic understanding of SourceCred. (Agree/Disagree 1-5)
- I have useful skills I want to contribute. (Agree/Disagree 1-5)
- I know how to start contributing. (Agree/Disagree 1-5)
- It was easy to start contributing to SourceCred. (Agree/Disagree 1-5)
- When I contribute, I know what’s expected of me. (Agree/Disagree 1-5)
- What is the most frustrating part about trying to understand the scope of SC?
- What is the biggest barrier you faced before you could start contributing?
- What do you need the most to be able to contribute effectively?
Resources
- I know what resources/tools are available to me as I learn about/interact with SourceCred. (Agree/Disagree 1-5)
- I can easily find the documentation I need. (Agree/Disagree 1-5)
- The documentation is useful and relevant. (Agree/Disagree 1-5)
- It’s easy to share ideas and have conversation in the Discord. (Agree/Disagree 1-5)
- It’s easy to get answers to my questions when I ask them. (Agree/Disagree 1-5)
- I know who leads what in SourceCred. (Agree/Disagree 1-5)
- I have the tools I need to work effectively in SourceCred. (Agree/Disagree 1-5)
- I know how much cred/grain I have. (Agree/Disagree 1-5)
- What tool, support, or resource would make the biggest impact in your ability to join or start a project in SourceCred?
Connection
- I feel comfortable in the SourceCred community. (Agree/Disagree 1-5)
- Someone in SourceCred cares about my experience. (Agree/Disagree 1-5)
- People in SourceCred are willing to help me. (Agree/Disagree 1-5)
- Others in SourceCred recognize the value I’m bringing to the project. (Agree/Disagree 1-5)
- I can use my skills to make SourceCred better. (Agree/Disagree 1-5)
- How did the experience of onboarding into SourceCred make you feel?
- What experience and/or resource would have improved your onboarding the most?
- How do you feel when you spend time with the SourceCred community?
- What would (or what does) make you feel like you belong in the SourceCred community?
Open to any suggestions around how to rephrase questions to make them more potent, how to condense this list more, or any other feedback!