https://scholars.lib.ntu.edu.tw/handle/123456789/632365
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.author | Hsieh W.-T | en-US |
dc.contributor.author | SHAO-YI CHIEN | en-US |
dc.creator | Hsieh W.-T;Chien S.-Y. | - |
dc.date.accessioned | 2023-06-09T07:52:42Z | - |
dc.date.available | 2023-06-09T07:52:42Z | - |
dc.date.issued | 2021 | - |
dc.identifier.uri | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85126359031&doi=10.1109%2fISMAR-Adjunct54149.2021.00036&partnerID=40&md5=d45172393947a0f75b2bb6198ef76ac4 | - |
dc.identifier.uri | https://scholars.lib.ntu.edu.tw/handle/123456789/632365 | - |
dc.description.abstract | Even though the Virtual Reality (VR) industry is experiencing a rapid growth with ever-expanding demands today, VR applications have yet to provide a fully immersive experience. The insufficient resolution of the VR head-mounted display (HMD) hinders the user from further immersion into the virtual world. In this work, we attempt to enhance the immersive experience by improving the perceptual resolution of VR HMDs. We employ an efficient neuralnetwork-based approach with the proposed temporal integration loss function. By taking the temporal integration mechanism of the Human Visual System (HVS) into account, our network learns the perception process of the human eye, and temporally upsamples a sequence that in turn improves its perceived resolution. Specifically, we discuss a possible scenario where we deploy our approach on a VR system equipped with the eye-tracking technology, which could save up to 75% of the computational load. Compared with the state-of-the-art in terms of the inference time analysis and a user experiment, it shows that our approach runs around 1.89× faster and produces more favorable results. © 2021 IEEE. | - |
dc.relation.ispartof | Proceedings - 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2021 | - |
dc.subject | Artificial intelligence; Computer graphics; Computer graphics; Computer vision; Computer vision problems; Computing methodologies; Computing methodologies; Displays and imagers; Graphics systems and interfaces; Graphics systems and interfaces; Human computer interaction (HCI); Interaction devices; Perception; Computing methodologies; Virtual reality; Human-centered computing | - |
dc.subject.other | Eye tracking; Helmet mounted displays; Human computer interaction; Neural networks; Virtual reality; Computer vision problem;; Computer vision problems; Computing methodologies; Display and imager; Graphic system; Graphics interface; Human computer interaction; Human-centered computing; Interaction devices; Perception;; Virtual reality;; Computer vision | - |
dc.title | Learning to Perceive: Perceptual Resolution Enhancement for VR Display with Efficient Neural Network Processing | en_US |
dc.type | conference paper | en |
dc.identifier.doi | 10.1109/ISMAR-Adjunct54149.2021.00036 | - |
dc.identifier.scopus | 2-s2.0-85126359031 | - |
dc.relation.pages | 133-138 | - |
item.fulltext | no fulltext | - |
item.openairecristype | http://purl.org/coar/resource_type/c_5794 | - |
item.cerifentitytype | Publications | - |
item.openairetype | conference paper | - |
item.grantfulltext | none | - |
crisitem.author.dept | Electronics Engineering | - |
crisitem.author.dept | Electrical Engineering | - |
crisitem.author.dept | Intel-NTU Connected Context Computing Center | - |
crisitem.author.dept | Networking and Multimedia | - |
crisitem.author.dept | MediaTek-NTU Research Center | - |
crisitem.author.orcid | 0000-0002-0634-6294 | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | Others: University-Level Research Centers | - |
crisitem.author.parentorg | Others: International Research Centers | - |
crisitem.author.parentorg | College of Electrical Engineering and Computer Science | - |
crisitem.author.parentorg | Others: University-Level Research Centers | - |
顯示於: | 電機工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。