How would you like to get more from your data collection efforts without doing more data collection?
I’m talking about getting more out of your surveys, rubrics, engagement data, and even your event attendance tracking information without asking more questions or taking up more of students’ time. And how would you like to do it without having to maintain or rely on your own records of data and information about students?
Let’s talk about data integration. Most institutions have multiple data sets stored in various places and within various systems: Student enrollment and records information (including demographics, address, transcripts, financial aid, and more) is stored within your Student Information System (SIS), class participation and grade data is stored within your Learning Management System (LMS), student participation or engagement data is stored within a student engagement platform, and your assessment data may be stored in a dedicated Assessment Management System (AMS).
Through a little technological magic, we can link and connect these data sets. And by “we”, I mean that you’re likely going to need to bring in your fellow campus data guardians. While some collaboration may be needed, connecting these data sets is possible and beneficial for multiple parties.
I’ll talk more about the how later on; first let’s talk more about why you would want to do this.
Let’s focus just on student affairs professionals connecting to their Student Information System (SIS). If you are able to tap into this, you could shorten your data collection efforts on forms and surveys and eliminate the need for students to self-report information about themselves, such as their majors, identity demographics, and class years.
All you would need is to collect a common identifier (such as institution email or ID number), which will enable you to pull in that student’s information from the SIS.
Beyond reducing the number of questions you’ll repeatedly ask students to answer, integrated data systems can help ensure more accurate and consistently collected data.
Consider these scenarios:
I’m sure you can identify with these data dilemmas and pain points. The confusion around institutional definitions or classifications, as well as accuracy and consistency of student information, can all be taken care of by tapping into the SIS instead of asking for students to repeatedly self-report.
Plus, as I alluded to in the career services example, when we have access to institutional data sets and utilize them, we gain insight into equity considerations. We can accurately know our student populations, making it easier for us to disaggregate (separate complete data set into distinct groups of data) our collected data related to engagement, satisfaction, and performance.
With disaggregated data, we can see where the identities of students significantly differ from our goals or learning targets. When disaggregating data or looking for differences related to identity, it is important to either compare identity populations against an institutional target or set population-specific targets. Be careful not to compare identities against one another, as that can make it seem like you view one population as superior over another.
All of those examples are just pointing to connections within the SIS, but if you add in the LMS, AMS, and other data systems, you’ll have a recipe for some awesome collaborations. Imagine being able to talk about student population behaviors or trends that you can link to classroom engagement/performance, identities and demographics, major/credits earned, and more. You could invite student engagement and advising staff, the registrar, and faculty to consider things like course load, completion, and progress of involved students.
Such rich and robust data connections might assist you in making progress toward understanding big, complex concepts — like the connections between a student’s sense of belonging and academic success.
Now that you have an idea of application and use cases for integrated data systems, here are a few steps and considerations to make this a reality at your institution.
Beyond what is presented here, you may have to go through more steps to get the data connected. Likewise, there may be some data sets that are easier or more likely to be connected than others.
Any data connection is a good one, so take what you can get. And don’t be surprised if, when you go asking to connect, you find out that many data sets are already connected! In that case, explore how you can leverage these connections for your engagement or assessment purposes…and then tell your coworkers to spread the word.
As my institution, National Louis University, has worked out the kinks in connecting the data and scheduling how often it refreshes, we’ve benefitted from being able to connect student experience data with grades (from our LMS) and student identity information (from our SIS). This has given us a robust picture of the student experience. We’re able to assess their behaviors and performance inside and outside of the classroom, all while being able to disaggregate or focus on particular demographics for insights or trends among populations.
It has been particularly helpful at our institution to check in monthly as a Business Intelligence group. This group consists of our BI person, the director of IR, the coordinator of our Banner system (SIS), and the many data-oriented folks like me who have a stake (and access) with these connected data sets. This committee-like setting allows for sharing with one another if there is new data available, discussing data initiatives (like putting together a data dictionary), or brainstorming solutions regarding difficulties we have experienced with certain data pulls, analyses, or visualizations.
In bringing people together to discuss these data sets, we have found that we all exist on a spectrum of knowledge and familiarity with the systems and skills necessary to work with these data sets. As such, we developed user groups to build capacity around tools like Power BI for analysis and visualizations, as well as skills like using SQL for data queries. We save and share our training and professional development materials so that when new people join the groups or gain access to the data, they have content to reference and learn on their own.
Enough about me; we’d love to hear from you! For folks who may have done this already, do you have any additional tips, tricks, or lessons learned? Let us know by connecting with us on Twitter @themoderncampus and @JoeBooksLevy.