eAssessment News

Maths quizzes in Moodle using Maple TA

maths-by-ajc1-on-flickrLTI have a one year site licence for Maple TA for this academic year.

Maple TA is an online testing and assessment software designed especially for quantitative disciplines that involve the use of maths and statistics.  It has many features including:

  • integration with Moodle;
  • visualisation of mathematical problems;
  • automatically generating questions;
  • free response answers for questions that have more than one correct answer;
  • automatic marking and the provision of instant feedback;
  • adaptive testing with individualised question paths.

If you are interested in using MapleTA for your course or just want to find out more email LTI.Support@lse.ac.uk

Tablets in Teaching and Learning: Marking and Feedback

In 2014, teachers from LSE’s Language Centre started exploring the use of technology to mark and provide feedback on students’ written work. After trying out three tools (Moodle, iPads and annotation apps, Snagit) with her colleague Catherine (see blog post), Lourdes Hernandez-Martin decided to focus on the use of iPads and worked on the project with Mercedes Coca.

Turnitin in Moodle rolls out

tiimoodle

Learning Technology and Innovation are pleased to announce the roll out of Turnitin originality check from within Moodle across the School from Tuesday 16th August.

Turnitin provides originality checks against webpages, library catalogues, journals and publications but also other student submitted work (within LSE and other institutions). By integrating Turnitin into Moodle, originality checking becomes more efficient, reliable and a robust solution in identifying matched text through the production of originality reports and scores (%); viewed directly within Moodle.

Learning Technology and Innovation (LTI) have trialled the integration at eleven departments across the School; liaising with ARD, GLPD, IMT, SU and TLC throughout.

We will roll out the integration across departments and are developing supporting material for teachers and students ranging from documentation, videos, FAQs etc.

If you would like LTI to demo how Turnitin in Moodle works; Book a place to our briefing  or get in touch with LTI for 1-2-1 or departmental sessions.

For full details on the rollout and the resources available, please visit the Turnitin page.

 

 

Announcing the IGNITE! Grant Winners!

Successful projects funded through the IGNITE scheme are now underway. We had over 20 project applications put to the committee and after much deliberation projects were chosen for their innovation, scalability and alignment to the School’s Education Strategy. Here are the winners:

Enhancing Your Moodle 

  • Jennifer Jackson-Preece, European Institute
    • (Re)designing  Moodle courses EU450, EU457 and Eu458 to maximise their pedagogical aims and deliver with a more distinct look and feel with clear links to Mahara for professional skills development.

Online Blended Learning

  • Lourdes Hernandez-Martin, Language Centre
    • A multilingual platform of audio and audio-visual materials to develop students’ interactive aural skills and increase their language exposure.
  • Nancy Holman, Geography and Environment
    • Developing professional skills the use of Participatory Action Research to deliver a practice-based learning project which provides engagement, consultation and Research in Urban Geography and Planning, especially when partnering with organisations such as a local authority.
Innovation, by Boegh on Flickr

Innovation, by Boegh on Flickr (CC)

 Feedback and Assessment with Technology 

  • Edgar Whitley, Management
    • Developing a scalable feedback system that integrates with Moodle and works effectively for the three constituencies affected by feedback: students, faculty and professional service staff.

Gamification 

  • Jose Javier Olivas and Jessica Templeton, LSE100
    • Experiencing the Dynamics and Limitations of Market and Regulation through Gaming by incorporating game design mechanics and techniques aimed at encouraging knowledge, skills development, collaboration and discussions in reference to the academic literature.
  • Andrea Pia, Anthropology
    • The Long Day of Young Peng is a point and click serious game exploring key themes in the study of contemporary China through the eyes of a young Chinese Migrant.

SADL Celebration: ending term on a digital high

SADL SeniorsLast week saw the official end of the SADL Programme for 2015/16 and students and staff got together in the Studio in the Saw Swee Hock to report on their group projects, be presented with their certificates and prizes for the best blog posts and generally let their hair down before the end of term.

The evening started with each of the three groups discussing the research project they had been working on together since Michaelmas Term. Each group was supervised by three of our Senior Ambassadors and the projects included:

  • how to improve learning spaces at LSE
  • how to improve assessment and feedback and
  • how to improve peer support.

The groups were given complete freedom in how they wanted to interpret the question and how to present their findings, however they were supported by the Seniors. The first group led by Djelila, Simran and Vikki were tackling the question of how to improve learning spaces at LSE. This is a really important question and the group highlighted some of the issues with the current learning spaces at LSE and how they felt they could be improved.

The next presentation was from Eugene, Katie and Chandra were investigating how to improve assessment and feedback at LSE. Again lots of issues were raised and the students had carried out a survey to gather the opinions from their peers about how improvements could be made.

Finally we heard from the group led by Geteesh, Chantel and Melissa who explored how peer support might be improved. The group talked about what peer support is and had lots of suggestions for how technology and face to face contact can build a peer network.

Rebecca, Djelila and Ella Throughout SADL we encouraged students to blog about their experiences rewarding them with Amazon vouchers for their blog posts. We also had a prize for the best blog post over the course of the year and two runners up. We were looking for a reflective piece of writing, that emphasised digital literacy and shared ideas with others. The blog posts were judged by Valerie Brese who was a SADL student last year, Sierra Williams from LSE’s Impact Blog and Heather Dawson from the Library.

We are delighted to announce the winner was Ella Sun for her blog post on OneNote or Evernote. The two runners up were Rebecca Quinn for her post on referencing, no longer a pain in academia and Djelila Delior who wrote about how SADL got me hired, who is also one of our Senior Ambassadors.

Congratulations to all the SADL students this year. They will all receive a statement on their PDAM record for their contribution to the programme and be eligible to apply to be a Senior Ambassador next year to help shape the programme.

Blog post written by Jane Secker (Digital Literacy and Copyright Advisor) and is taken from the SADL blog

  • e-assessment
    Permalink Gallery

    ‘Assessment and Feedback with technology’ project 2014/15

‘Assessment and Feedback with technology’ project 2014/15

Over the academic year 2014/15 LTI have led several projects  in order to try and improve assessment practices with technology at LSE.

The following are the outcomes of the work carried out as part of the assessment and feedback with technology project:

Research

e-Assessment Practice at Russell Group Universities report Read e-Assessment Practice at Russell Group Universities report

A survey distributed to Russell Group universities to identify level of engagement with e-Assessment practice and factors conductive and critical to e-Assessment engagement.

Assessment and Feedback with technology at LSE report Read Assessment and Feedback with Technology at LSE report – please request a copy of the report.
Interviews with LSE Departments were carried out to identify the level of engagement with e-Assessment practice and understand the factors that encourage participation as well as barriers involved in this regard.

Pilots

A series of pilots with various departments to explore pedagogical benefits of assessment and feedback with technology 

Government e-assessment Pilot study report Read GV100 e-Assessment pilot study
Government (GV100)
Characteristics:
Timed, on-campus invigilated and typed formative exam, followed by online Self/Peer review and face-to-face Student-Teacher feedback
Technologies used: Exam4, Bring Your Own Device (BYOD), Moodle-TurnItIn (TII) PeerMark
Law e-assessment Pilot study report Read Law e-assessment pilot study
Law (LL205 & LL4K9)
Characteristics:
Timed, take-home and typed formative mock exam
Technologies used: ExamSoft
LSE100 portfolio assessment Pilot study
Read LSE100 portfolio assessment pilot study
LSE100
Characteristics:
e-portfolio for summative assessment
Technologies used: Moodle assignment
Moodle- TII integration Pilots  

Read Moodle-TII integration pilots report
Moodle – TurnItIn integration

  • Statistics (ST327)
    Characteristics: Originality checking
    Technologies used: Moodle-TII integration
  • Philosophy (PH400 & PH201)
    Characteristics: Originality checking, TII GradeMark
    Technologies used: Moodle-TII integration, ipads
  • Media and Communications (MC425 & MC419)
    Characteristics: Originality checking, TII GradeMark
    Technologies used: Moodle-TII integration
  • Government (GV100)
    Characteristics: TII PeerMark
    Technologies used: Moodle-TII integration

DECISIONS MADE for Moodle-TII integration: Where the Moodle-TII integration worked, the feedback was largely positive.  In the instances where the integration did not fully work, the issues identified were significant and cannot be ignored.  In most cases, workarounds provided solutions; however as a result of the relative uncertainty associated with the functionality of the plug-in, LTI will not scale Moodle-TII integration but continue supporting the integration in the form of pilots.  As such, the plug-in will be made available upon request to those who want to use it (i.e. teachers will have an opportunity of requesting the plug-in from LTI for any given Moddle course(s)).

If you want to take part in Phase 2 of Moodle-TII integration (i.e. use the plug-in for your Moodle course(s)) please email us on lti.support@lse.ac.uk

Visit our Moodle site for details of the Moodle-TII integratin phase 2, database of issues identifies and participating pilot users

LTI Grants

The following LTI Grant projects are related to e-Assessment. Find out more about the LTI Grants (e-Assessment innovation strand) and  LTI Grant winners or apply for an LTI Grant.

  • The social construction of human rights violations: e-Bricolage project,
    Pete Manning, Department of Sociology
    Use of peer assessment for an e-bricolage project, using resources produced for exam preparation and essay preparation.
  • From E-marking to E-feedback: training, applying and evaluation,
    Catherine Xiang & Lourdes Hernández-Martín, Language Centre
    Exploring new ways of marking and giving feedback (Moodle, iPads+annotation apps, Snagit).
  • Integrating offline marking and online moodle feedback using iPads,
    Ellen Helsper, Media & Communication
    Teachers using iPads and the Moodle-Turnitin integration to mark and give feedback on formative coursework (uploaded by students on Moodle).
  • Global perspectives via documentary and peer-assessment,
    Catherine Xiang, Language Centre
    Use of videos in continuous assessment with peer review of the documentaries created  – fully embedded in the continuous assessment.
  • Using film in urban planning analysis,
    Nancy Holman, Geography
    Creations of short interpretative films along with written work and presentation following fieldwork. The student produced films are formatively assessed by a panel of staff in the department. The films are part of the presentation students make at the end of the course.
  • Moodle-based group assessment for regression analysis using the R software,
    Sarah Geneletti, Statistics
    A project looking into replacing written report with a three part assessment: i)R Script ii) stats Moodle quiz iii)Moodle quiz report based on the analyses.
  • Electronic marking and feedback with iPads (Phase II)
    Lourdes Hernandez-Martin & Mercedes Coca, Language Centre
    Explore iPad apps to improve assessment and feedback

Guidelines

The following guidelines were produced to cover needs of innovative practic:

Testing and evaluation of technologies and tools

New features for Moodle

Moodle

 

Moodle was upgraded to version 2.7 as part of the reset process.  The changes to Moodle are minimal and can be seen below along with some features of Moodle that you may not be aware of.

 

 Changes to Moodle

New text editor
Atto is the new default text editor in Moodle from version 2.7 onwards.  Clicking the top left icon (highlighted in red below) will expand it to three rows.

The previous text editor (‘TinyMCE’ shown below) contains additional font style settings and the paste from word button.  If you prefer the old editor you can select the TinyMCE as your default text editor from your profile settings.Tiny MCE editor

Go to Administration > My Profile settings > Edit profile.

Then select ‘TinyMCE html editor’ from the drop down list for Text editor, then click ‘update profile’.

Improvements to Quizzes
2.7 sees the introduction of new features to quiz question banks, including question duplication, moving questions and save changes and continue editing buttons.  The essay question now allows students to add an attachment with no accompanying text.

Improvements to assignments
Teachers can now comment directly on students work when they submit via online text.

Some features you may not be aware of:

Turnitin plugin

This plugin allows work to be submitted automatically to Turnitin, ( the plagiarism checking software ) directly from the assessment activity.  Teachers can then mark and give feedback using the Turnin GradeMark features.  If enabled students can also see their originality reports and use this information for plagiarism prevention training.

Student view of turnitin submission

 

 

 

 

This feature is being enabled to individual courses on request.  For more information about using this tool or to take part in a pilot please contact LTI.Support@lse.ac.uk or see the Moodle-Turnitin Integration Moodle page.

Activity completion

This can be set up to record the completion of various activities in your course.  A check (tick) Checkbox imageappears    against the activity when the student meets the criteria you have set (e.g. viewing an activity, submitting an assignment, or passing an assignment).

Activity completion

 

 

Once you have set up your assessments with activity completion details you can then set up the completion details for the whole course. Go to ‘course completion’ in the administration block and, select ‘Course is complete when all conditions are met’ and then select all activities to be completed.

You can then access a quick view to see if students have completed the activities in your course by going into ‘Administration’, > ‘Reports’, > ‘Course completion’.

Activity completion report2

 

 

 

 

 

This report can be filtered by course group or student name.

You can also allow students to view if they have completed each activity according to the settings chosen.

Student view of activity completion

To find out more details on how to use these features or if you have any other Moodle queries contact LTI.Support@lse.ac.uk

Marking and Giving Feedback with iPads

Last academic year, staff in the Spanish Section at LSE’s Language Centre were awarded an e-Assessment grant from LTI to support their project of using iPads and annotating apps to mark and give students feedback electronically.

Why use tablet marking and feedback…

…from the teacher’s point of view…

Several applications were analysed and the three teachers who participated in the project each selected the one that they found easier to use. Some advantages that were common to all teachers:

Advantages of using

the iPad and apps

Improvements on

marking and feedback

  • portability
  • paperless
  • online backup
  • possibility to add comments
  • rubrics to reuse common comments
  • apps suitable and adaptable to participants’ marking styles
  • encourages reflection on marking and feedback
  • opportunities to improve student understanding by extracting and analysing data held
  • clearer and more detailed feedback

 

…from the students point of view…

iPadsDuring the first term students’ were exposed to the “traditional” and “electronic” way of marking and giving feedback and were then asked to answer an evaluation questionnaire in order to determine their preferences in terms of writing and submitting their work, and receiving feedback. Overall many students did not show any preference with regards to traditional and electronic assessment. Those more in favour of e-assessment and feedback gave the following reasons:

* confidence of knowing work is backed up

* e-feedback easier to use so more likely to revisit at a later date

* improved clarity and understanding of feedback

Want to know more ? Click on the picture below to get the full report. You’ll find details on the apps that were used along with a very useful comparison grid to help you choose the right tool.

EMASpanish

 

E-Marking and e-Feedback: what else?

Using tablets to enhance marking and feedback is only one option in what is known as Electronic Management Assessment (EMA). Following on this project the language centre is now working on a wider EMA project entitled “From-e-Marking to e-Feedback: training, applying and evaluating” which aims at raising awareness of and comparing three distinctive e-marking and e-feedback methods, one of them being iPad marking. This project is being funded by an LTI e-assessment grant and an update will be provided when it is completed.

LTI is working on EMA and its use at the LSE. Watch out this space for updates on projects.

Also have a look at JISC’s guide on EMA to discover how you can use technology to support the assessment lifecycle.

 

 

How effective are e-Marking and e-Feedback?

Catherine Hua Xiang

There are numerous methods and tools to mark and provide feedback using technology. Catherine Hua Xiang and Lourdes Hernandez-Martin from LSE’s Language Centre run an LTI-funded project* aimed at ‘exploring and comparing three distinctive e-marking methods and e-feedback as a result of three marking tools’

Lourdes Hernandez-Martin

More than 20 members of staff at the Language Centre were offered training on using Moodle, iPads with e-pens and Snagit to mark and provide feedback on students’ written work. They applied the three different marking methods to the same group of students throughout the academic year on different pieces of work (usually long essays).

They were then asked to write a reflective diary on the impact of these methods on the way they mark while students answered a survey to explore their perception of video and written feedback. The findings demonstrated a clear preference for video feedback using Snagit, which Catherine and Lourdes explained by providing the following reasons:

  1. Linguistic enhancement – Students have found being able to listen to teacher’s correct helps both pronunciation as well as overall listening skills.
  2. Personal approach – Students preferred the personal approach of a video feedback as it creates the style which is most similar to a face to face interaction. The teacher’s voice helps engage the students.
  3. Quality of the feedback – Students have commented on the details that verbal feedback could offer as opposed to the written feedback.
  4. Others – Students also commented on the usefulness of having both – the fact that they can come back and listen to the feedback at any time they wishes. It offers great materials for revision purposes.

“It is very helpful having the teacher guide me through the corrections as it is more personal and can allow me to see not just what is wrong but why it is wrong

“It’s much better to hear something directly rather than having to try and work things out from comments or notes written down”

“you can learn from home, rather than having to come in for office hours”

 

Snagit

Snagit Features

 

* From e-Marking to e-Feedback: Training, Applying and Evaluation, project funded by a Learning Technology and Innovation Grant. You can also find some information and updates on this project in the LSE Language Centre website.

 

LTI Show and tell on assessment with Technology, 11 November 2014

assessment with technologyLTI recently held a show and tell on assessment with technology with colleagues from LSE, UCL and Westminster. The event was well attended and provided an opportunity to find out the varying ways that technology is being used in to innovate assessment.

The show and tell event is part of the work that is being done by LTI to promote assessment with technology at LSE. The project aims and outcomes outlined by LTI learning technologists Athina Chatzigavriil and Kris Roger can be seen here.  If you are interested in being involved in the working group on e-assessment or have examples of e-submission, e-marking or e-feedback and e-return then please get in touch by emailing lti.support@lse.ac.uk

A lecture capture recording of the event (slides and audio) is now available here (LSE login required) or you can read a brief summary of the presentations below.

Alternatives to examinations

Professor George Gaskell started off the event with a brief outline of the changes that are taking place in LSE100, the compulsory course for Undergraduates at LSE. The LSE100 Director explained that the course team are currently investigating alternatives to exams. Using the learning outcomes of the course as the basis for assessment they have been developing a portfolio of activities that will allow students to demonstrate their appreciation of apply social scientific methods, concepts and theories to real world problems. Assessments will have to allow for ‘exit velocity’ and let students to take risks in their first year and allow for the progress of learners over their two years at LSE, while also preventing strategic planning by requiring all components to be completed. The process is still in the developing stages so watch this space for updates.

Peer assessment

papanicolasIriniSmallDr Irini Papanicolas, from Social Policy gave the second presentation on her work with Steve Bond in LTI on peer assessment. Dr Papanicolas discussed how she changed assessment on the course SA4D4 from 100% exam, to 50% exam and 50% presentation. She used ‘WebPA’ to enable students to rate their peers’ presentations using the course mark frame. Although peer assessment was an optional part of the assessment all the groups volunteered feedback and there was a positive response to the process with it creating discussion within the groups on the assessment criteria.

Dr Papanicolas will be using ‘TeamMates’ for this year as it will allow students to not only rate their own groups’ presentation but the individuals contributions within the group.

From peer assessment to peer teaching and learning….
Kevin Tang then reported how ‘Peerwise’ has been used at UCL. Kevin has been working with Sam Green & Stefanie Anyadi in the department of Linguistics to use the platform with 50 undergraduate and 50 postgraduate students. PeerWise allows students to create, answer and discuss questions. Students can rate feedback and are scored on their own contributions, at UCL these contributions are then worth a small percentage of their summative mark for the course.

Research into using the interface indicated that it was important to provide support for students to ‘think like an examiner’ with example questions and training on giving constructive feedback. Academic staff attitudes also played a crucial role in student engagement along with setting regular activities and deadlines.

As most examiners will know it is quite hard to create good questions so UCL asked students to devise questions in groups and found that the questions improved over time with the students in mixed ability groups appearing to benefit the most. The platform provided a space for interaction as students provided detailed feedback for each other which was then used to work on future questions and students were still using the system leading up to the exam for revision purposes.

Games and assessment in Law

Dr Vassiliki Bouki, Principal Lecturer, University of Westminster talked about the use of games in assessment. Dr Bouki demonstrated the ‘law of murder game’ which was developed in ‘Articulate storyline’ and was used as an alternative to coursework for a second year criminal law module. The game was used to demonstrate a real life scenario and assess critical thinking and allowed students to experience role playing to think like a lawyer. Students are given two hours to complete several small tasks in an open book environment. The game is currently in use so data and feedback from students will be available later in the year.

Word processed timed assessments and online feedback

Sunil KumarDr Sunil Kumar, Lecturer in Social Policy & Dean of Graduate Studies, talked about his experiences over three years on the course ‘urbanisation and social policy’. Concerned about how much students were actually learning with the traditional model of examinations, Dr Kumar introduced a 2 hour online formative assessment into his course. Students typed up their answers to short answer and long answer questions in examination style conditions. Dr Kumar was then able to read and mark submissions on his iPad and then upload the anonymised assessments with annotated feedback for all students to see on Moodle. The formative assessments have had 100% attendance with students being able to then learn from other students submissions, encouraging them to review topics they have not yet covered in preparation for the summative examination.

More information about the project can be found on our blog post.