• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

University of Utah Students Unveil A New Direction for Game Controllers

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
47,294 (7.53/day)
Location
Hyderabad, India
System Name RBMK-1000
Processor AMD Ryzen 7 5700G
Motherboard ASUS ROG Strix B450-E Gaming
Cooling DeepCool Gammax L240 V2
Memory 2x 8GB G.Skill Sniper X
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) BenQ 1440p 60 Hz 27-inch
Case Corsair Carbide 100R
Audio Device(s) ASUS SupremeFX S1220A
Power Supply Cooler Master MWE Gold 650W
Mouse ASUS ROG Strix Impact
Keyboard Gamdias Hermes E2
Software Windows 11 Pro
University of Utah engineers designed a new kind of video game controller that not only vibrates like existing devices, but pulls and stretches the thumb tips in different directions to simulate the tug of a fishing line, the recoil of a gun or the feeling of ocean waves.

"I'm hoping we can get this into production when the next game consoles come out in a couple of years," says William Provancher, an associate professor of mechanical engineering who is in Vancouver, British Columbia, demonstrating the new game controller with his students March 5-7.



They are demonstrating the device and presenting studies about it during the Institute of Electrical and Electronics Engineers' Haptics Symposium. Haptics deals with research about touch, just as optics deals with vision. A patent is pending on the device.

The first haptic or touch feedback in game controllers came in 1997 with the Nintendo64 system's "rumble pack" that makes the hands vibrate using an off-balance motor to simulate the feel of driving a race car on a gravel road, flying a jet or dueling with Star Wars light sabers, Provancher and colleagues write.

His new controller does something additional: it delivers directional cues to the player by stretching the skin of the thumb tips in different directions.

"We have developed feedback modes that enhance immersiveness and realism for gaming scenarios such as collision, recoil from a gun, the feeling of being pushed by ocean waves or crawling prone in a first-person shooter game," Provancher says.

The latest game controller prototype looks like controllers for Microsoft's Xbox or Sony's PlayStation but with an addition to the controller's normal thumb joysticks, on which the thumbs are placed and moved in different directions to control the game. In the new controller, the middle of each ring-shaped thumb stick has a round, red "tactor" that looks like the eraser-head-shaped IBM TrackPoint or pointing stick now found on a number of laptop computer brands.

If a gamer's avatar runs into a wall, the tactor under the thumb moves back to mimic impact. Both tactors can move from side to side to mimic ocean waves. And when a fish bites in one of the games the researchers tried, "as the fish jerks on the line, you can feel the tactor jerk under your thumb," Provancher says.

Video games commonly are designed so the left thumb stick controls motion and the right controls the player's gaze or aim. With the new controller, as a soldier avatar crawls forward, the player pushes the left thumb stick forward and feels the tactors tugging alternately back and forth under both thumbs, mimicking the soldier crawling first with one arm, then the other.

Provancher also hopes to adapt the new game controller design for use as a smart phone peripheral device. A phone would fit into the device with game-controlling thumb sticks and tactors on each side of the phone.

Of Thumbs and the New Game Controller
Smart phones provide an analogy for the new advance in game controllers, Provancher says. Early smart phones used vibrations only when the phone rang. Current models use more sophisticated feedback: a vibration with each touch to help users improve their accuracy when they use a touch-screen keyboard.

Provancher's previous research showed that skin-stretch devices on a steering wheel could stretch the index finger tips left or right to tell drivers to turn left or right - and did so just as accurately as a navigation system's computerized voice. His latest research is more than fun and games because "by placing skin-stretch feedback in a game controller, it creates a nice testing environment for understanding human perception and cognition," he says.


Indeed, a critical question in determining if the new game controller would work dealt with how players perceived front-back and left-right tugs at their thumb tips when the thumbs were angled inward as they are in a typical Xbox or PlayStation controller.

A study analyzing how gamers perform with the new, thumb-tip feedback device was conducted by Provancher, computer science doctoral student Ashley Guinan, computer science master's degree student Rebecca Koslover and mechanical engineering master's student Nathaniel Caswell. The research was funded by the National Science Foundation and the University of Utah.

The study, which Guinan was presenting during the Haptics Symposium, found that gamers' brains made the necessary mental rotation of the directional tugs so they could perform just as well if their thumbs were angled as if their thumbs were straight.

Provancher says the angled thumb position is better ergonomically, both in terms of comfort and of ease in pushing forward with angled thumbs.

He says that his future research will focus on details of how to provide skin-stretch feedback effectively at the same time a game also produces sounds, sights and vibrations.

Provancher's earlier study of the steering wheel device that told the fingertips which way to turn showed that information can be conveyed by touch even when auditory and visual information also are present.

View at TechPowerUp Main Site
 
Joined
Jun 2, 2009
Messages
115 (0.02/day)
Location
Gurnee, IL
Processor AMD Phenom II x2 550BE
Motherboard Asus M4A79T Deluxe
Cooling OCZ CNPS10X Flex (Dual 80cfm fans)
Memory OCZ Reaper 1866 4GB
Video Card(s) ASUS EAH4870 Dark Knight 1G
Storage 150gb WD Raptor
Display(s) Viewsonic Optiquest Q22wb
Case Apevia X-Navigator
Power Supply OCZ ModXStream Pro 500W
Software Windows 7 Ulitimate (64bit)
Great idea but I doubt that it will be a big hit...For those that play FPS games on consoles, this is a no go. Grand idea for feedback in a game but still doesn't beat RL. Maybe just another hint to get sometime in the sun perhaps?
 

Fitseries3

Eleet Hardware Junkie
Joined
Oct 6, 2007
Messages
15,508 (2.47/day)
Location
Republic of Texas
cool but it looks odd

 
Joined
Jan 2, 2007
Messages
601 (0.09/day)
Location
Under Columbus, Ohio
System Name Gen0cide
Processor AMD Phenom x4 920 2.8 @ 3.36 1.44v
Motherboard Asus M2N-Deluxe + WiFi
Cooling Thermoright True Rev C
Memory 2x 2gig of Gskill DDR2 1066 @ 5-5-5-15 20 2.125v
Video Card(s) Gigabyte 250 GTS 1 Gig
Storage 5x 730gig 7,200 RPM Raid 5 Western Digital Black
Display(s) Neovo F-417
Case Antec Twelve Hundred
Audio Device(s) On-Board
Power Supply SeaSonic M12 SS-600HM
Software Windows 7 x64 / Arch Linux-fluxbox(duel Boot)
im sorry kinda reminds me of how ya play with nipples
 

FordGT90Concept

"I go fast!1!11!1!"
Joined
Oct 13, 2008
Messages
26,259 (4.44/day)
Location
IA, USA
System Name BY-2021
Processor AMD Ryzen 7 5800X (65w eco profile)
Motherboard MSI B550 Gaming Plus
Cooling Scythe Mugen (rev 5)
Memory 2 x Kingston HyperX DDR4-3200 32 GiB
Video Card(s) AMD Radeon RX 7900 XT
Storage Samsung 980 Pro, Seagate Exos X20 TB 7200 RPM
Display(s) Nixeus NX-EDG274K (3840x2160@144 DP) + Samsung SyncMaster 906BW (1440x900@60 HDMI-DVI)
Case Coolermaster HAF 932 w/ USB 3.0 5.25" bay + USB 3.2 (A+C) 3.5" bay
Audio Device(s) Realtek ALC1150, Micca OriGen+
Power Supply Enermax Platimax 850w
Mouse Nixeus REVEL-X
Keyboard Tesoro Excalibur
Software Windows 10 Home 64-bit
Benchmark Scores Faster than the tortoise; slower than the hare.
I could so see getting sores on my thumbs because of that. Not to mention a high failure rate due to complexity and those nipples (for a lack of better word) wearing down so they no longer make contact with the skin. Oh, and those recesses will quickly get packed with dirt/debris rendering them inoperable after weeks/months of heavy use.

Good theory, yes, but I can't see any of the big three (Nintendo, Microsoft, nor Sony) adapting this technology.
 

Yo_Wattup

New Member
Joined
Jan 26, 2012
Messages
788 (0.17/day)
Location
Brisbane, Australia
System Name Desktop/Gamer/Digital Audio Wokstation ||| HTPC
Processor 2500k @ 4.65ghz ||| AMD A8 @ 3.6ghz
Motherboard ASUS P8Z68-V Pro
Cooling Noctua NH-D14 with single Blue Antec Tri-Cool 120mm ||| Stock
Memory 16GB G.Skill Ripjaws X 1600 @1900mhz 8-9-9-24 ||| 8GB G.Skill 1600 CL9
Video Card(s) 2x HIS HD6950 2GB Crossfire, 6970 clocks ||| HD6550D
Storage 120GB Intel 320 series SSD + 2TB storage ||| 1TB Seagate
Display(s) 32" Sony Bravia LCD 1080p ||| 50" Hitachi Plasma 1080p
Case Raidmax Raptor modded to 7 fans ||| A compact HP Case
Audio Device(s) Firewire audio interface + two 9" studio monitors, 450 REAL watts ||| onboard
Power Supply Corsair TX 750W ||| generic 400W
Software Win 7 Ultimate + Win 8 consumer preview||| Win 7 Pro
Benchmark Scores Never drops below 60fps Battlefield 3 everything on max, fov 90. :D
Joined
Feb 23, 2008
Messages
1,064 (0.17/day)
Location
Montreal
System Name Aryzen / Sairikiki / Tesseract
Processor 5800x / i7 920@3.73 / 5800x
Motherboard Steel Legend B450M / GB EX58-UDP4 / Steel Legend B550M
Cooling Mugen 5 / Pure Rock / Glacier One 240
Memory Corsair Something 16 / Corsair Something 12 / G.Skill 32
Video Card(s) AMD 6800XT / AMD 6750XT / Sapphire 7800XT
Storage Way too many drives...
Display(s) LG 332GP850-B / Sony w800b / Sony X90J
Case EVOLV X / Carbide 540 / Carbide 280x
Audio Device(s) SB ZxR + GSP 500 / board / Denon X1700h + ELAC Uni-Fi 2 + Senn 6XX
Power Supply Seasonic PRIME GX-750 / Corsair HX750 / Seasonic Focus PX-650
Mouse G700 / none / G602
Keyboard G910
Software w11 64
Benchmark Scores I don't play benchmarks...
So, the same feedback principles found in PC joysticks, but stuck in a gamepad?

Could be interesting, I just hope for the final product they'll work more on the button placement, as the way they have it on the prototype is very impractical for some gametypes. And it's not like it needs to be symmetrical to please equally left- and right-handed people. That doesn't matter much for a gamepad.
 
Joined
Nov 21, 2007
Messages
3,688 (0.59/day)
Location
Ohio
System Name Felix777
Processor Core i5-3570k@stock
Motherboard Biostar H61
Memory 8gb
Video Card(s) XFX RX 470
Storage WD 500GB BLK
Display(s) Acer p236h bd
Case Haf 912
Audio Device(s) onboard
Power Supply Rosewill CAPSTONE 450watt
Software Win 10 x64
interesting idea, i'd have to try it out at a store or something first before being sold on it. Definitely support the idea of developing it as i'm sure they could manage to finagle a way to implement with just regular thumb-sticks instead of the stupid eraser idea.
 
Joined
Jun 17, 2007
Messages
7,336 (1.15/day)
Location
C:\Program Files (x86)\Aphexdreamer\
System Name Unknown
Processor AMD Bulldozer FX8320 @ 4.4Ghz
Motherboard Asus Crosshair V
Cooling XSPC Raystorm 750 EX240 for CPU
Memory 8 GB CORSAIR Vengeance Red DDR3 RAM 1922mhz (10-11-9-27)
Video Card(s) XFX R9 290
Storage Samsung SSD 254GB and Western Digital Caviar Black 1TB 64MB Cache SATA 6.0Gb/s
Display(s) AOC 23" @ 1920x1080 + Asus 27" 1440p
Case HAF X
Audio Device(s) X Fi Titanium 5.1 Surround Sound
Power Supply 750 Watt PP&C Silencer Black
Software Windows 8.1 Pro 64-bit
What is the max tug? Is that the permanent layout/form? Cause if so, that just won't do. Will it break easy if I have really strong thumbs and manage to balance out the off balances with enough resistance?

A lot of questions to be raised.
 
Joined
Aug 19, 2011
Messages
529 (0.11/day)
System Name As Himself
Processor 2700X
Motherboard Asrock 370X ThaiChi
Cooling Custom Liquid
Memory 4133MHz Team
Video Card(s) Radeon VII
Storage Samsung 512 SSD's
Display(s) Asus "24 144Hz
Case Tt P5
Audio Device(s) Asus Essence One Muses/Sparkos
Power Supply EVGA 1200
Mouse RAT ProX
Keyboard Drop CTRL
Software W10 steam futuremark
fooly cooly anyone???
 

MyFriendOfMisery

New Member
Joined
Feb 20, 2012
Messages
2 (0.00/day)
They've got nothing on mouse and keyboard!

No matter how hard the companies push in obviously a wrong direction, nothing can beat the mouse and keyboard.

Joysticks and gamepads were fun when you were 8 or 10 of age and only for certain simple games. Otherwise, you can play any complex game with them. And because they know that, they simply chose to ruin new games, making them more like "walk there and a cinematic scene starts". Pity really.
 
Top