ez itt az index

Computer graphics and machine vision

Activity of the research group:

The Computer Graphics group focuses on real-time GPU-based photorealistic image synthesis, off-line CPU-based global illumination, non-photorealistic/artistic imaging simulation, medical/physical/engineering systems simulation and visualization, image processing, machine vision, and tomographic reconstruction.

Recent results:

• Dynamic PET reconstruction system algorithms and GPU implementation
• GPU-based sampling and reconstruction
• Non-Euclidean geometries in games and virtual reality systems
• Real-time algorithmic photography: fog, rain, etc. Elimination
• Deep learning applications in image processing and graphics
• Retinal transfer function determination (collaboration with Botond Roska’s group in Basel)

Former students have gone on to professional management positions at Intel, Google, Amazon, Weta Digital, Industrial Light&Magic, Disney, DreamWorks, etc.Attila Áfra, a former PhD student and current Intel researcher, won this year’s Technical Oscar, the highest award for practical application of computer graphics.

Special infrastructure:

GPU server • Reconstruction server • GPU workstation

Recent projects:

VKSZ • VEKOP • VKE • OTKA

International relations:

Universidad de Girona • Cseh Műszaki Egyetem • Auckland University of Tech. • Pompeu Fabra University • NMI Reutlingen • Griffith University • Universitat Wien

Industrial partners:

Mediso

Biomedical informatics

The activity of the research group:

The aim of the group is to conduct high-quality interdisciplinary basic and applied research and to develop applications in both engineering and biomedical sciences. There are medical informatics applications in a vast range of fields. The group will address these diverse needs by involving students from MSc and BSc courses.

The Medical Informatics group carries out activities and research related to the following areas of specialisation:

• Physiological process modelling. Physiological control systems. Computer modelling and simulation. Health and medical informatics.
• Medical image reconstruction methods. Image processing methods for healthcare applications.
• Design, manufacture, installation and operation of biomedical equipment and instrumentation. Measurement of physiological processes, computer analysis of biomedical signals, biometrics.
• Providing the instrumentation and measurement background for biomedical research and design of experiments.

The Group has traditionally maintained good relations with distinguished centres of excellence in both the medical and engineering professions. We cooperate with hospitals, companies and other universities and research institutes. We are open to both interested students and partners.

Recent results:

• More effective SPECT image reconstruction methods than before, in a joint project with Mediso Ltd, have been incorporated into the company’s products.
• An internationally collaborative protocol for tight blood glucose control in intensive care units has been developed and applied in medical practice.

Special infrastructure:

Aurora electromagnetic tracking system

Recent projects:

H2020-MSCA-RISE • OTKA • ERAPERMED

• DCPM: Digital Clone for Personalized Medicine (EU H2020-MSCA-RISE-2018 call, GA: 872488) consortium project leader
• PerFluid: Personalised perfusion guided fluid therapy (Reference Number: ERAPERMED2021-250)
• OTKA K137995 – Models and Methods for Personalized Intensive Care

International relations:

University of Canterbury • University of Liege • Furtwangen University • Monash University • University of Otago

Industrial partners:

Semmelweis Egyetem Nukleáris Medicina Tanszék, Orális Diagnosztikai Tanszék, Transzlációs Medicina Intézet, Városmajori Szív- és Érgyógyászati Klinika • SZTE • DE • Mediso Kft. • CROmed Kft. • Kinepict Kft. • Evopro Innovation Kft. • Heitec Hungary Kft. • SafePay Systems Kft.

Artificial Intelligence

Activity of the research group:

Our research covers the full spectrum of artificial intelligence (MI), organically linked to our group’s decades-long faculty role in general AI education, which is now present in BProf, BSc, MSc and PhD programs. Our working groups within the research group are Digital Humanities, Image Processing and Multimodal Diagnostics, Cooperative Intelligence, and Computational Biomedicine (ComBine). Digital Humanities examines semantic technologies through the processing of natural language. Image Processing and Multimodal Diagnostics explores the integration of classical image processing and information fusion methods with new artificial intelligence-based methods. Cooperative intelligence research examines federated learning, sensor networks, autonomous vehicles, multi-agent systems, and distributed computing methods. The ComBine team is developing artificial intelligence methods for bioinformatics, chemoinformatics and health informatics, with a particular focus on data and knowledge fusion, systems-based data analysis, and causal discovery.

Recent results:

We have launched an Artificial General Intelligence course to teach about the grand challenges, limits, trends, interdisciplinary nature and ethical, social dimensions of artificial intelligence. Our group is also participating in the development of a new Human-Centered Artificial Intelligence MSc program, which is part of an international EU project. We have launched and organized a student competition at the faculty in Artificial Intelligence and Machine Learning for the third time. In our research, we routinely use and constantly expand our Bayesian systems-based analysis to support biomarker discovery in several projects (UKB1602, TRAJECTOME, OTKA119866, OTKA139330). In addition to our statistical genetic research, we also focus on the development of AI methods for chemoninformatics and drug discovery, which is strengthened by our participation in national and international projects (MELLODDY). Our intelligent image processing and multimodal data fusion research has also been boosted by new projects, and we are examining the use of modern artificial intelligence tools in natural language processing in several collaborations.

Recent projects:

H2020/IMI2, MELLODDY • EUREKA, iCare4NextGen • OTKA K139330

International relations:

University of Minnesota • K.U.Leuven

Industrial partners:

SOTE • Richter • Dealogic • Abylon Kft. • E-Group • Continental

Cognitive computing

Activity of the research group:

The aim of the research group is to develop procedures that rely on wearable physiological measuring instruments, mostly to monitor and make learning more effective. Research and implementation of virtual and augmented reallity applications is also in focus, within industrial application areas.

Recent results:

• Designing a software framework, identifying measurement processes, finding the definitive variables and the relationship between them
• Preprocessing algorithm for uniform classification of fMRI images
• Defining mental states, designing profile curves and classifiers from ECG, EEG and pupil data
• Design and build a software package to validate results

Special infrastructure:

Google Pixel devices • DayDream VR • Samsung Gear VR devices, controllers • Mobil EEG (eMotive) • Hololens

International relations:

Stanford University

Industrial partners:

Audi • Academy of Music

Speech Communication and Smart Interactions

Activity of the research group:

Our lab group is an “old hand”, we have been present at the Department of Telecommunications and Media Informatics of the Budapest University of Technology and Economics since the beginning. Our main areas of expertise are speech communication and speech technology in Hungarian, human-machine, human-robot interfaces, assistive interfaces for blind, visually impaired and speech impaired users, general statistics and modern machine learning algorithms. A strong focus on deep learning research and education. We have gained experience in a number of national and international projects in the broader field of ICT applications (customer service automation, self-driving cars, etc.). Our technologies have been applied in practice in these areas for decades.

Recent results:

• Research:
  • H2020 projects (AI4EU partner, APH-ALARM AAL partner, VUK and PAELIFE AAL projects), MI coalition activity, member of national laboratories (MI Lab, InfoLab),
• Industry:
  • Continental Professional Intelligence for Automotive project, Idomsoft ücustomer service automation, IT.DOT MÁV voice passenger information, OTP speaking ATMs (in daily use, also in other banks besides OTP + government systems under implementation/planning)
• Education:
  • Educating academia and industry on artificial intelligence and deep learning.
  • Introduction of practical deep learning and HCI teaching at the faculty, Teaching of Speech Information Systems, Brain Signal Processing, Speech and Hearing Diagnostics, Participation in the development and teaching of Infocommunication and other subjects
  • NVidia Deep Learning Institute organisation and delivery of full-day workshops on deep learning for academics and students

Special infrastructure:

GPU servers

Recent projects:

OTKA • CELSA

International relations:

University of Novi Sad, Serbia • University of Ss. Cyril and Methodius, Skopje, Macedonia • diap Research Institute, Martigny, Switzerland • Université Pierre et Marie Curie, Paris, France • Langevin Institute, ESPCI-ParisTech, Paris, France • Tianjin University, Tianjin, China • University of Cologne, Cologne, Germany • Universidad Industrial de Santander Bucaramanga, Santander, Colombia • UPC Barcelona, Barcelona, Spain • National University of Defense Technology, Changsha, China • AGH University of Science and Technology, Department of Measurement and Electronics • University of Ss. Cyril and Methodius in Skopje, Macedonia • Università della Campania Luigi Vanvitelli and IIASS • Université Grenoble Alpes • Universidad Industrial de Santander Bucaramanga, Santander, Colombia

Industrial partners:

ELTE • SOTE • ELKH • Hospitals • Idomsoft • IT.DOT Kft • OTP • Microsoft Mo. Kft. • Auxiliis Pharma Kft. • SCI Hálózat zRt.