History of Pen and Gesture Computing:
Annotated Bibliography in On-line Character Recognition,
Pen Computing, Gesture User Interfaces and Tablet and Touch Computers
Copyright © 20241221 22:38:26 EST
This posting is an annotated bibliography focused broadly on touchscreen and gesture user interfaces,
on-line character recognition (a.k.a. dynamic character recognition, a.k.a. pen and touch computing),
both hardware and software. It has been a continuing work-in-progress since the 1980s.
It includes references on related technical topics I have encountered in my career: for example PDAs/highly-portable computing,
cryptographic communications, signature verification, biometric authentication, and digital rights management (DRM).
I am posting it as a service to those with interest in the field.
It may also be of special interest to anyone investigating any of the areas of
digitizer tablets, touchscreens, character recognition, touch/gesture user interfaces,
multi-touch computing, passive and active tactile feedback, touch and proximity sensors,
augmented reality, haptics, context-dependent intrepretation of user input, and applications including the same.
It covers the time period from approximately 1887 / 1891 (first electronic tablets with "touch" input and a display),
through 1914 (first electronic gesture/handwriting-recognition input and user-interface system),
to the first handwriting-recognition tablet device connected to a modern electronic computer in 1957 (the "Stylator")
and the more famous Rand Tablet (1961),
to the present day.
As with any subject, the focus has modulated over the decades, and this bibliography follows these topics both forward in time, and historically back in time.
Tablets and touchscreens have evolved into a variety of pointing devices, into PDAs and smart-phones, locating and gesturing sensors with three-dimensional input with six degrees of freedom, and more.
For example, there are no real lines between touch sensing for robotics, touch and contact sensing for user human input, fingerprint sensors, and touch and proximity sensing in general.
Likewise, there are no real lines between haptics for touchscreens, haptics for instrumentation, and biometric feedback.
Earlier work on handwriting recognition, with handwritten symbols sometimes used for command input as "gestures",
has evolved to be part of a much broader range of gestures, including in-air and 3D gestures.
Command user interfaces have merged with direct manipulation, and then with graphical user interfaces and virtual reality.
Authenticating handwritten signatures has evolved to additional forms of dynamic biometrics.
Haptic feedback has evolved from "simple" force-feedback to encompass tactile stimulation using electrovibration and sonic shock waves, and perceptual effects of visual and audio signaling.
Virtual reality systems seem to have waxed and waned, and waxed again.
It is, indeed, a rich and complicated field, in all its aspects.
- This compilation and all annotations are copyright © Jean Renard Ward, 1992, 1996, 2003, 2005, 2008, 2009, 2011, 2013, 2015, 2017, 2019, 2020, 2022, 2023.
- Permission is hereby given to link to these pages, or to cite or use this information in publication,
including confidential reports, provided notice of the source is given as stated below along with the full URL of this page.
| Source: | Annotated Bibliography in On-line Character Recognition, Pen Computing, |
| | Gesture User Interfaces and Tablet and Touch Computers, and related topics |
| | Copyright ©Jean Renard Ward |
References from the approximate years 2024 to (present).
- [Igus24a]
Igus GmbH
"Automated touchscreen quality control with igus ReBeL",
http://rbtx.com, Igus GmbH, archived August 27, 2024
Product note on six-axis / 6DOF motion stage marketed for automatic/robotic testing touchscreens and touchpads. Same motion state used for visual inspection, keyboard/keypad testing. Also Delta robot for pick-and-place.
- [MierseM24a]
Mierse, Markus
"A Sci-Fi Aerial Display: this touchscreen floats in midair",
IEEE Spectrum, November 2024, pp. 14..16
Do-It-Yourself in-air projected "touchscreen" (virtual touchscreen) using three time-of-flight proximity sensors to determine position of user's fingers/hands, and retro-reflector projector with half-silvered beam splitter reflector to project real image of actual display to give illusion of touchscreen display floating in air. Compare with 3D optical touchscreens, "put-that-there"?
- [OptoFidelity24a]
OptoFidelity
"TOUCH Automated touch screen testing OptoFidelity; Functional and performance testing for touch displays, display components, and assemblies",
http://www.optofidelity.com, archive 2024
Product information on automatic/robotic touchscreen testing: multi-touch touchscreens, multi-finger gestures, tap/swipe/pinch/rotate gestures. Refers to touch accuracy, jitter (motionless, or along straight ling), touch linearity, reporting rate, touch resolution, latency between touch input and touch event in software, touch sensitivity.
- [SinghDK24a]
Singh, D.D.
"Dictionary of Mechanical Engineering",
Springer Nature Singapure Pte Ltd., 2024
Dictionary of mechanical engineering terms. "Normalizing" as a form of heat treatment, adjustment in productivity levels for comparison of work time by different workers.
- [Wikipedia24a]
Wikipedia.org
"Stick Shaker",
http://Wikipedia.org, 2024
History of stick shaker and stick pusher, vibrotactile feedback as stall warning: vibration is also audible.
- [Wikipedia24b]
Wikipedia.org
"Computer terminal",
http://Wikipedia.org, 2024
History of (keyboard) computer terminals. Includes IBM 3270 line-mode (line-at-a-time) and block-mode (block-oriented, screen-at-a-time) terminals to offload interrupts on IBM 360 mainframes by local editing in terminal, send final characters on "Send" or "Enter". VT-100 and X3.64 escape sequence code standards, X Window System terminal-like interaction, terminal emulation. Discusses intelligent terminals, but does not mention handwriting recognition terminals by Pencept or CIC.
Mirrors of this page can be found at:
|
What we should fear is not that we might be wrong,
but that we might do wrong.
|
"So gut, wie jeder schreiben und lesen lernt,
muss jeder schreiben und lesen dürfen."
-- Karl Marx
|
ATGT,
Advanced Touchscreen and Gesture Technologies,
Android user interfaces,
Android,
Blue Spike,
CV,
C.V.,
Computing,
Content Guard,
ContentGuard Corporation,
D.R.M.,
DRM,
Ericsson,
GO Corporation,
GO,
GUI,
GUIs,
Google,
HCI,
HTML,
HWX,
I.P.R.,
IDE,
IPR,
Inter Partes Review,
ITO,
Java,
Jean Renard Ward curriculum vitae,
Jean Renard Ward cv,
Jean Renard Ward,
Jean,
Lenovo,
Lucent Technologies,
Lucent,
M.I.T.,
MULTICS,
machine learning,
Markman hearing,
Markman,
Microsoft Surface,
Microsoft,
Motorola,
Networking,
Networks,
Nokia,
Orange Book,
PHP,
PKI,
PTAB,
Patent Office,
Pen Computing,
Pen,
Pen-Point,
PenPoint,
Pencept,
Perl,
Python,
RSA,
Renard,
Samsung,
Tablet Computing,
Tablet PC,
Technologies,
Touchscreen Computing,
U.S.P.T.O.,
UI toolkits,
UI,
USPTO,
WIMP,
Ward,
Windows for Pen Computing,
Windows,
accessibility computing,
accessibility technology,
accessibility,
acoustic touchscreen,
alpha blending,
analysis,
assistive technologies,
asymmetric key cryptography,
asymmetric-key cryptography,
authentication,
biometric authentication,
biometrics,
blind,
capacitance,
capacitive sensor,
certificate,
character recognition,
claims analysis,
claims chart,
claims construction,
coding,
color maping,
color mapping,
composite video,
computer access,
computer graphics,
computer input device,
computer mice,
computer mouse,
computer pointing device,
computer security,
computer,
conductive film,
consultant curriculum vitae,
consultant cv,
consultant,
contact sensor,
content management,
content security,
controllers,
copy protection,
copy-protection,
cryptanalysis,
cryptographic mask,
cryptographic protocol,
curriculum vitae,
curriculum,
cv,
data authentication,
data encryption,
data entry,
data structures,
deposition,
detection,
digital certificate,
digital encryption,
digital rights management,
digital rights,
digital signature,
digital signatures,
digital,
electro-vibration,
electronic display instrument,
electronic document,
electronic pen,
electronic signature,
electronic,
electrovibration,
encryption,
expert report,
expert witness curriculum vitae,
expert witness cv,
expert witness,
expert,
feedback,
finger gestures,
fingerprint scanner,
firmware,
for,
force feedback,
gesture recognition,
gestures,
graphical user interfaces,
graphics,
hand gestures,
hand-held,
handheld device,
handheld mobile device,
handheld,
handwriting recognition,
haptic feedback,
haptic,
haptics,
hashing,
human-computer interaction,
iPad,
iPhone,
inadvertent touch,
indium tin oxide,
input devices,
input techniques,
intellectual property,
inter-partes review,
interaction techniques,
interactive surfaces,
interface,
international patent litigation experience,
kinetic scrolling,
light pen,
lightpen,
litigation support,
litigation,
malware detection,
malware,
managements,
micropattern,
mobile computing mobile device input,
mobile computing,
mobile device input,
mobile devices,
mobile keyboard,
mobile user interfaces,
momentum scrolling,
mouse,
multi-touch,
multitouch,
mutual capacitance,
mutual capacitive,
network security,
on-screen keyboard,
one-finger gesture,
palm rejection,
patent litigation,
patent,
patents,
pen gestures,
pen interfaces,
pen,
phone user interfaces,
pinch-to-zoom,
pointing device,
pointing devices,
position sensor,
position-sensing interactive display terminal,
position sensor,
post-WIMP user interfaces,
power management,
programming environments,
programming,
projected capacitance,
projected capacitive,
proximity sensor,
proximity sensors,
proximity,
public key encryption,
public-key encryption,
resistive,
rights,
root-kit,
rootkit,
rootkits,
screen display,
screen door transparency,
screen reader,
screen-door transparency,
screen-reader,
screenreader,
scroll gesture,
scrolling,
security,
self capacitance,
self capacitive,
sensors,
signature verification,
signatures,
single-finger gesture,
slide-to-unlock,
smartphone user interface,
smartphone user interfaces,
smartphone,
source code analysis,
source code,
source-code analysis,
source-code,
sourcecode analysis,
sourcecode,
stroke gestures,
styli,
stylus,
symmetric-key cryptography,
table-top computing,
tablet controller,
tablet controllers,
tablet hardware,
tablet,
tabletop computing,
tablets,
tactile feedback,
tactile sensor,
testimony,
text entry,
touch detection,
touch gestures,
touch input device,
touch screen devices,
touch input,
touch pad,
touch screen devices,
touch screen input,
touch screen,
touch screens,
touch sensor,
touch sensors,
touch strip,
touch tracking,
touch,
touch-pad,
touch-screen,
touch-sensitive screen,
touch-strip,
touchpad,
touchscreen gestures,
touchscreen graphics,
touchscreen,
touchstrip,
transparent conductor,
transparent film,
trial,
trojan,
user interface design,
user interface patents,
user interface software,
user interface technology,
user interface,
user interfaces,
user,
vibrotactile,
virtual keyboard,
visual programming,
visually impaired,
visually-impaired,
vitae,
web design,
web user interfaces,
window managers,
witness,
zoom gesture,
Main Page
(Next page) penhist