Diksha
Augmented Reality Search - Taking ETB’s One Step Ahead

Organization:
National Digital Education Architecture (NDEAR), Department of School Education & Literacy (DoSEL)

PS Code:
(AK1094)

Institute:
Pimpri Chinchwad College of Engineering and Research, Ravet, Pune, India

Theme: Smart Education

Problem Statement:
The challenge was to enhance the Educational Technology Backbone (ETB) by integrating Augmented Reality (AR) into DIKSHA, enabling students to delve deeper into their textbooks. The objective was to develop a plugin that utilizes algorithms and Natural Language Processing (NLP) to empower students to scan images or diagrams in textbooks, fetching relevant content from DIKSHA or other online sources. This approach aims to stimulate curiosity, fostering participatory learning and creating a seamless educational experience.

Workflow Diagram

Building Blocks:
LayoutLM:
Distinguishes between text and 'image labels'.Ensures accurate context detection for textbook pages.
Tesseract:
An open-source engine for text recognition.Supports multiple languages.

Keyword Filtering (RAKE):
Filters keywords based on degrees and frequencies of occurrences.Requires minimal computational resources.

Uniqueness:
Keyword Extraction:
Extracts the most relevant keywords from scanned text, providing users with selectable options.

Scalability:
Majority of computations occur on the server, ensuring consistent performance across various devices.

Cost-Effective:
Developed entirely on open-source technologies, aligning with DIKSHA's tech stack, resulting in minimal development costs.

My Contribution:
In this collaborative project, my role primarily focused on UI Design and conducting research on similar projects from the past. I aimed to create an intuitive and user-friendly interface while ensuring alignment with the project's goals. The research component involved studying existing solutions to inform our design choices and ensure innovation in our approach.

Outcome:
The outcome is a groundbreaking educational tool that merges technology and learning seamlessly. By encouraging students to explore their textbooks interactively, the AR Search enriches the educational experience, fostering curiosity and active engagement. The project's emphasis on cost-effectiveness and scalability aligns with the broader objectives of NDEAR and DIKSHA.

Technical Stack:
LayoutLM, Tesseract, OCR, Keyword Filtering (RAKE)Open-source Technologies.
This project demonstrates the power of collaboration, innovation, and user-centric design in the realm of digital education.

Note: PS Code refers to Problem Statement Code, AISHE stands for All India Survey on Higher Education, and UI denotes User Interface.

Play Store Link for App: Diksha