Crowdsourced Idea Convergence

Selection Criteria

After the generation and filtering of several ideas, selection criteria method assists the idea evaluation according to how well the defined criteria are met.

What? Selection criteria facilitate the shortlisting phase by the assessment of certain quality dimensions of each idea. Widely adopted selection criteria are feasibility, novelty, elaboration, and relevance (based on Dean et al. 2006). See also Holistic & Analytic scales.

Why? Every idea can be evaluated based on several selection criteria. The selection criteria provide a guide for identifying the most adequate ideas for solving specific problems. The criteria differ depending on the underlying problem. The most prominent ideas are selected according to how well each criterion is met.

How? Each idea is assessed according to certain criteria in a 5-point likert scale. In the example below, the following criteria are used:

The total score of an idea is a weighted average of the individual criteria scores. As a result, ideas are ranked according to the final score.

Example: Idea Contest

While the knowledge around IT is becoming mandatory in business education, at many universities the Information Systems courses are not effective at teaching the future generation of business managers the key concepts for thriving in the digital innovation era. Therefore, we ask the following question: What kind of digital resources would support, enhance and improve the teaching of IS courses? Please provide your ideas.

Digital Transformation in Education Ideas


Students can listen to a podcast while...

Students can listen to a podcast while they run, exercise or commute. As part of a flipped classroom design, a course meeting is prepared by a podcast that delivers a conversation between the class lecturer and a representative of a real-world case organization that undergoes profound digital transformation. The podcast is led in by a clear description of the learning objectives and some structure and recommendations for viewpoints that encourage students to focus their attention on a select course topic, for example the IT governance, risk and compliance aspects of the case organization at hand.


A Virtual Reality-empowered digitalization...

A Virtual Reality-empowered digitalization of physical workplaces can be experienced by walking and looking around. Students can immerse themselves into the virtual equivalent of physical workplaces amenable to digitalization, such as industrial workplaces and Industry 4.0 enhancements. The workplaces are configurable and can be re-designed by the students. Each design can be experienced and solutions of individual students or student teams can be connected with each other to design business processes that link multiple workplaces together.

Foundation Video inputs

For hands-on content, e.g., XML/XSLT...

For hands-on content, e.g., XML/XSLT, students can prepare the basic principles by watching short video sequences (what are xml complex types) with a short quiz at the end. These inputs will help to get the actual lecture started with some pre-knowledge so that the lecture/seminar can focus on discussions & exercises.

Play while you learn

This idea is about putting...

This idea is about putting the concept of Gamification into education. Similar to SQL Island, a fun game story is developed that allows a player to 1) get a quick repetition of learning content, 2) decide for a solution, and get 3) feedback about the correctness before the story can continue. Again some technical knowledge would be most easy to implement. Yet, it would also be cool to implement a more management topic. Similar to the website game that once was published on the website of Panama papers.


When teaching students...

When teaching students rather practical topics like data analysis or programming, an online code editor could be provided. An integration with learning management platforms would allow lecturers to give homework or even exams over the web and to get the students' work back in a format that's easy to process and might even grade automatically. The students could practice their coding skills from any computer in the world, as long as they have a web browser.


Students often must solve...

Students often must solve group tasks in their seminars and do that always with the same people. Why not collaborate with other students from around the world? A video-messenger with collaboration features could connect students who are working on the same topic. Lecturers can submit their current topic and get matched with another lecturer who has a class working on the same topic. They can then discuss and arrange a virtual meeting, or if it doesn't fit they look for further opportunities. Both students and lecturers profit from different perspectives and might make some new friends!


There are procedures...

There are procedures involving given software use, that students should be able to perform. This refers especially to various statistical tests and analyses in SPSS, R Studio or Stata. Statorial would be a collection of tutorials, with detailed step-by-step instructions of how to perform them in given software. Apart from the software-related instructions, there would be a brief description of a test and an example of when to use it with a walkthrough.


A strong grounding in IT...

A strong grounding in IT is increasingly important for business education. For students to understand, appreciate and advance the concepts of IS, critical thinking is required. Students should drop the archaistic strategy of learning learning material by heart and should enhance their learning experience through critical thinking. The AI-Reflector is here to support this process. The tool supports students by providing cases studies and reflective questions, so that students focus on identifying their own solutions on a real-life problem. The tool does not "correct" the solutions of the students but rather asks further questions so that the students can take into consideration all potential options. According to the students answers, well-known examples can be provided. If, for example, a student is expected to recommend solutions on how forecasting accuracy could be improved and mentions through AI, then the tool refers to the well-known example of Nestle for further reflection.


Mobile, quiz application...

Mobile, quiz application testing and consolidating students' knowledge after the lecture. Everyday in the morning (or other time) a single multiple-choice question appears that should be answered. Depending on the frequency of classes, there could be at least 7 potential areas to ask about (1 for each day of the week). The questions could also repeat themselves, especially in case the answer was not correct at the first attempt. There would be an elaborate explanation available as well.

Reflective Questions

What are the advantages and disadvantages of using analytic scales for idea evaluation?

In which cases the analytic scales are not suitable for idea evaluation?

Creative Commons License This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Austria License.