Student Experience Surveying

Student Experience Surveying

SUMMARY

The Student Experience Surveying Policy establishes the University's approach to surveying to enable effective evaluation of the student experience whilst minimising survey demands on individual students.

The Procedure provides further information concerning the management, application, analysis and reporting of surveys, supported by Schedule 1 - Student Experience Surveying.

POLICY

1     PURPOSE

To optimise university surveying to enable effective evaluation of the student experience whilst minimising survey demands on individual students.

2     BACKGROUND

Evaluation of the student experience is an expectation of the Australian Government and has been listed in the Higher Education Standards Framework (HESF). Seeking feedback gives agency and voice to students and helps to inform staff at all levels in their decision-making.  

Surveys may be used to collect information about student expectations, needs and their experiences of educational and non-educational programs and services. Surveys such as questionnaires and focus groups, for example, are commonly used evaluation methods by governments and universities.

A more streamlined and centralised life-cycle approach to survey administration has been adopted by the University to manage the scheduling and timing of surveys, and to help maintain the highest levels of data integrity and reliability. In addition, it is intended to reduce the number of surveys of students by the University about the student experience, whilst not precluding surveys to address specific local needs (see Procedure).                 

3     SCOPE

Enterprise surveys, such as those that secure feedback from students about their experience with learning, information provided, enrolment and admission, orientation and progression, facilities and infrastructure, general and support services, activities and events for the purpose of quality enhancement are within the scope of this policy.

Learner surveys that secure feedback from students regarding the content, delivery and teaching of programs of study, and their constituent units, are also within the scope of this policy.  

For a list of University Enterprise and Learner survey activities, please refer to the Schedule. The Procedure details alternative survey, sampling and evaluative practices not in scope of this Policy.

This Policy applies to all staff and students at all campuses and locations of the University.   

4     DEFINITIONS

Commonly defined terms are located in the University Glossary.

‘Enterprise’ surveys refer to surveys that focus on mandated surveys such as those forming the Quality Indicators for Learning and Teaching (QILT) [http://www.qilt.edu.au/] under the Department of Education and Training, other externally benchmarked surveys, and internal University surveys specific to faculties, departments and offices for enhancing the quality of learning and teaching, employability and student experience.

Learner surveys refer to surveys that focus on curriculum or teaching, typically provided through the Office of the Pro Vice-Chancellor Learning and Teaching in the portfolio of the Deputy Vice-Chancellor Academic [https://staff.mq.edu.au/teaching/evaluation/].

5     POLICY STATEMENT

The evaluation of the student experience is important because it informs quality enhancement and strategic decision-making, aids institutional benchmarking, and provides agency to students. It can include measures to evaluate institutional, academic program, teaching, administration, amenity and support aspects of the student experience.

Mandatory Australian Government student experience measures and those with National and/or International benchmarking capability will be prioritized over other measures.

Student experience surveys will be, where possible, minimized to only those required to inform the experience at the various stages of the student lifecycle (refer to the Schedule).

Student experience surveys will be, where possible, developed, conducted, evaluated and reported in accordance with best practice principles (refer to the Procedure).   

Only surveys approved by the University nominee(s) as outlined by the Policy and listed in the Schedule may be administered. Authorisation for student experience surveys is by nominated member (s) of the University Executive (refer to the Procedure).  

6     RELEVANT LEGISLATION

Higher Education Support Act 2003 (HESA)
Tertiary Education Quality and Standards Agency Act 2011 (TEQSA)

7     KEY RELATED DOCUMENTS

Student Experience Surveying Procedure
Student Experience Surveying Schedule
Human Research Ethics Policy
Quality Enhancement Policy / Schedule
Academic Survey Evaluation of Teaching Procedures
Unit Guide Policy / Procedure
Enterprise Agreement

8     NOTES

8.1
Contact Officer

Deputy Vice Chancellor Students & Registrar (DVC-S&R)

8.2
Implementation Officer

Executive Officer, DVC-S&R

8.3
Approval Authority / Authorities

Deputy Vice Chancellor (Academic)
Deputy Vice Chancellor Students & Registrar (DVC-S&R)
Chief Operating Officer
Academic Senate

8.4
Date Approved

16 February 2016

8.5
Date of Commencement

February 2016

8.6
Date for Review

January 2018

8.7
Documents Superseded by this Policy

Nil

PROCEDURE

1     PURPOSE

To define the processes for management, application, analysis and reporting of Student Experience Surveys in accordance with the Student Experience Surveying Policy and Schedule.

2     SCOPE

This Procedure applies to all staff and students at all campuses and locations of the University.

3     DEFINITIONS

Commonly defined terms are located in the University Glossary. The following definitions apply for the purpose of this Policy:

Enterprise surveys refer to surveys that focus on mandated surveys such as those forming the Quality Indicators for Learning and Teaching (QILT) [http://www.qilt.edu.au/] under the Department of Education and Training, other externally benchmarked surveys, and internal University surveys specific to faculties, departments and offices for enhancing the quality of learning and teaching, employability and student experience. .

Learner surveys that secure feedback from students regarding the content, delivery and teaching of programs of study, and their constituent units. For example, those typically provided through Office of the Pro Vice-Chancellor Learning and Teaching in the portfolio of the Deputy Vice-Chancellor Academic.

4     RESPONSIBILITIES AND REQUIRED ACTIONS

Print version of Flowchart (PDF)
Please click on each item of the flow chart to see more information.

Student Experience Surveying ProcedureAD L&T / Director of Office / DVCSR as required provide...NOYESApproved?Review metrics  Benchmark outcomes and metrics Consider...Conduct the survey Collate responses  OWNER as per Schedule,...EXCEPTIONS   Approval Authority:  AD L&T / Director of...LEARNER as per Schedule  Approval Authority: DVCSR and DVCAENTERPRISE as per Schedule  Approval Authority: DVCSR and COOStudent Experience Surveying ScheduleStudent Experience Surveying PolicyType of Survey?Need for Survey as defined in Schedule or Identified by Staff...

STAFF
It is an expectation that all Macquarie University staff will comply with the Policy, Procedure and Schedule by actively pursuing opportunities to optimize and streamline university conducted or facilitated surveying of student experience.

In cases where staff wish to conduct alternative surveys for the purpose of evaluation of quality assurance of a program/service, that fall outside this schedule, Staff are responsible for seeking procedural advice (and approval) from Faculty Associate-Deans Learning and Teaching or Office Directors (in the first instance), and from the Office of the Deputy Vice-Chancellor Students and Registrar, if the enquiry cannot be addressed at Faculty or Office level.  

MEMBERS OF THE EXECUTIVE
Led by the Deputy Vice-Chancellor Students and Registrar, the Chief Operating Officer and Deputy Vice-Chancellor Academic share the following responsibilities:
  • Review metrics generated across student experience surveying to inform planning and resource allocation in the interest of improving the student experience;
  • Consider collaborative approaches to issues relating to student experience;
  • Benchmark university outcomes and metrics against national and international universities; and
  • Provide reports to the Executive Group, Senate, Council and the Student Advisory Board on outcomes of interventions and strategies to enhance the overall student experience.

The Office of the Deputy Vice-Chancellor Students and Registrar will oversee adherence to the Policy, Procedure and Schedule, respond to related enquiries and consider requests for exceptions to the Procedure and Schedule in consultation with the Office’s of the Chief Operating Officer and Deputy Vice-Chancellor Academic.

CHIEF OPERATING OFFICER
The portfolio of the Chief Operating Officer is responsible for conducting, facilitating and reporting on ‘Enterprise’ surveys such as those forming the Quality Indicators for Learning and Teaching (QILT) [http://www.qilt.edu.au/] under the Department of Education and Training, the new internal Macquarie University graduate destination survey, and other externally benchmarked surveys.

The portfolio is also responsible for providing advice to Staff on alternative approaches to student experience surveying such as sampling and collaborative approach to reduce survey fatigue among students – see the Schedule for more information.

DEPUTY VICE-CHANCELLOR ACADEMIC
The portfolio of the Deputy Vice-Chancellor Academic is responsible for designing, conducting, facilitating and reporting on Learner surveys that focus on curriculum or teaching, typically provided through the Office of the Pro Vice-Chancellor Learning and Teaching.

The portfolio is also responsible for providing advice to Staff on alternative approaches to student experience surveying such as embedding and interpretation of learning analytics – see the Schedule for more information.

5     RELEVANT LEGISLATION

Higher Education Support Act 2003 (HESA)
Tertiary Education Quality and Standards Agency Act 2011 (TEQSA)

6     KEY RELATED DOCUMENTS

Student Experience Surveying Policy
Student Experience Surveying Schedule
Human Research Ethics Policy
Quality Enhancement Policy / Schedule
Academic Survey Evaluation of Teaching Procedures
Unit Guide Policy / Procedure
Enterprise Agreement

7     NOTES

7.1
Contact Officer
Deputy Vice Chancellor Students & Registrar (DVC-S&R)
7.2
Implementation Officer
Executive Officer, DVC-S&R
7.3
Approval Authority / Authorities
Deputy Vice Chancellor (Academic)
Deputy Vice Chancellor Students & Registrar (DVC-S&R)
Chief Operating Officer
Academic Senate
7.4
Date Approved
16 February 2016
7.5
Date of Commencement
February 2016
7.6
Date for Review
January 2018.
7.7
Documents Superseded by this Procedure
Nil
7.8
Amendment History
Oct 2016 - update of flowchart to conform with Macquarie University branding.

SCHEDULE 1 

Schedule 1 - Student Experience Surveying

1     PURPOSE

To outline the annual schedule of approved student experience surveys, and their administration, associated with the Student Experience Surveying Policy and Procedure.   

2     SCHEDULE

2.1       Enterprise surveys

Survey What it measures Scale basis BenchmarkingAdministrationOwner
Student Experience Survey
(SES)
Student experience Five scales & two index items: Skills Development, Learner Engagement, Learning Resources, Teaching Quality,
Student Support,  &
Overall Quality of Teaching Index,
Quality of Entire Educational Experience Index
National (all 40 universities in Australia participate in this federal Govt survey)Administered
August – September  Reported December (MQ data) & March (National data) Report to: Executive Group. 
DVC SR
International Student Barometer (ISB) International  student satisfactionDecision Making, Application, Arrival Satisfaction, Learning Satisfaction, Living Satisfaction, Support Satisfaction, Careers SupportInternational (n=180) National (n=34) Administered: April - June Reported: October – December Report to: Executive Group.DVC SR
Graduate Outcome Survey
(GOS) (from Nov 2015)
Graduate employment outcome and further studies Full-time & Part-time employment 
Full-time & part-time study
National (all 40 universities in Australia participate in this federal Govt survey)Administered twice in a year
a. April –June
b. Oct - Dec
Reported December (MQ data) & March (National data)  Report to: Executive Group.
DVC A
Postgraduate Research Experience Questionnaire (PREQ) Satisfaction of higher degree research graduates Satisfaction on :
Supervision, Intellectual Climate, Skill Development, Infrastructure, Thesis Examination, Goals & Expectations, Overall Satisfaction
National (all 40 universities in Australia participate in this federal Govt survey)Administered twice in a year
a. April –June
b. Oct - Dec Reported: December (MQ data) & March (National data) Report to: Executive Group.
DVC A
Macquarie University Student Experience Questionnaire – HDR
(MUSEQ-R)
Higher Degree research student satisfaction Satisfaction on :
Supervision, Intellectual Climate, Skill Development, Infrastructure, Goals & expectations, Overall satisfaction with the quality of my higher degree research experience, with University services & facilities, quality of my supervision
Internal – trends over time Administered
September-October

Reported: February Report to: Executive Group.
DVC R
Macquarie University Graduate Destination Survey Graduate employment outcome and further studies close to one year after the course completionThis questionnaire is under construction to start from 2016 following up 2015 graduates to comply with the QS employability ranking data request.Internal - employability outcome information for the faculties , and trend overtime Schedule is being prepared – twice or three times a year, 11 months after completion of a course. Report to:
Executive Group
DVC A
LibQual + Library Client Survey
(INSYNC)
Client satisfaction with Library services, resources & facilities Satisfaction with services, access to resources, & facilities.   Libqual (1200 International institutions); Insync (40 National institutions)  Biannual
Report to: DVC/A
DVC-A
Enrolment/offer survey Satisfaction with enrolment/offer information & processesTBAMacquarie Annual, or after each session. Report to: Executive Group.DVC SR
SERMSport Facility Benchmarking 70 Performance indicators National Annual Report to: DVC S&RDVC SR
Childcare User Survey Parent satisfaction with Childcare Centre Performance against 7 quality indicators National (Australian Government Evaluation) Annual Report to: DVC S&RDVC SR

2.2       Learner surveys

Survey What it measures Scale basis BenchmarkingAdministrationOwner
Learner Experience of Unit (LEU)Obtain student feedback on specific Unit of study 12 core scale items on: Learning outcomes, standards and criteria; Feedback; Teaching sessions and learning activities; Information and organisation; Intellectual challenge; Workload; Graduate capabilities
Up to ten optional scale items (five chosen by Department, five by Unit Convenor)
Open-ended items (three scale-related, three overall)
Core items and scales derived from CEQ scales; Internal historical normsAdministered towards end of each teaching session Report to: SLTC & ASQCDepartment, Unit Convenor
(Data held by Office PVC L&T)
Learner Experience of People (LPE) /Planet (LPL) UnitObtain student feedback on People/Planet Unit of study 12 core LEU scale items (as above)
6 LEU open-ended items (as above)
Up to five optional scale items chosen by Unit Convenor
5 People/Planet scale items
2 People/Planet open-ended items
LEU core items and scales derived from CEQ scales; Internal historical norms (under development for People/Planet items)Administered towards end of each teaching session Report to: SLTC & ASQCDepartment , Unit Convenor
(Data held by Office PVC L&T)
Learner Experience of PACE Unit (PACE)Obtain student feedback on PACE Unit of study 6 core LEU scale items on: Learning outcomes, standards and criteria; Feedback; Workload; Intellectual challenge
2 LEU scale-related open-ended items
5 scale items relating to Graduate Capabilities
4 scale items specific to PACE learning
3 open-ended items specific to PACE
LEU core items and scales derived from CEQ scales; Internal historical norms (under development for PACE items)Administered towards end of teaching each session or following placement Report to: PVC L&T.Department, Unit Convenor
(Data held by Office PVC L&T)
Learner Experience of Unit Early Feedback Survey (EFS)Obtain student feedback on early experience in Unit of study 6 open-ended items focusing on early experience of unitNoneRecommended for administration in Week 2-3 of teaching session. Report to: Program ConvenorsUnit Convenors
Learner Experience of Teaching (LET)Obtain student feedback on individual teaching6 core scale items based on CEQ Good Teaching Scale
6 scale-related open-ended items
Up to 6 optional scale items chosen by teacher
3 standard open-ended overall items
Core items based on CEQ GTS; internal historical norms.Usually administered towards end of each teaching session Report to PVC L&T.Individual teacher
(Data held by Office PVC L&T)
Individual Supervisor Survey (ISS)Obtain student feedback on individual PG supervision6 open-ended items focusing on supervision experienceNoneAs requested by staff (but no more than twice annually).Individual supervisor
Learner, Project, and trial surveys (capstone, clinical, sessional staff, Kickstart, PACE, GLP)Obtain student feedback on programs, specific, curriculum innovation, capstone and clinical units, sessional staff teaching.Devised in consultation with stakeholdersN/AAs appropriate for purpose determined in consultation with the PVC L&T. Report to: PVC L&TAs appropriate for purpose
User Group surveys (iLearn, Web, MUSE)Obtain student feedback on level of service / user-ability.Devised in consultation with stakeholdersN/AAs appropriate for purpose determined in consultation with the PVC L&T.Directors of service areas.

3     NOTES

3.1
Contact Officer
Deputy Vice Chancellor Students & Registrar (DVC-S&R)
3.2
Implementation Officer
Executive Officer, DVC-S&R
3.3
Approval Authority / Authorities
Deputy Vice Chancellor (Academic)
Deputy Vice Chancellor Students & Registrar (DVC-S&R)
Chief Operating Officer
Academic Senate
3.4
Date Approved
16 February 2016
3.5
Date of Commencement
February 2016
3.6
Date for Review
January 2018
3.7
Documents Superseded by this Schedule
Nil
3.8
Amendment History
29 March 2016 – inclusion of PACE in 2.2 Learner, Project, and trial surveys, approved DVC(A) 25 March 2016
3.9
Policy Authorisation
Student Experience Surveying Policy
Back to the top of this page