Skip to content
problem genome

One of 592 unsolved problems in the Problem Genome, a collection written up for student design and engineering teams.

education · manufacturing

bump dots on a glass panel

Blind and low-vision home cooks mark flat-panel kitchen appliances with bump dots that fall off and blur together; 3D-printed tactile overlays built in 2017 worked for most users in a lab study but would likely disrupt capacitive touchscreens, and rehabilitation trainers still recommend low-tech fixes

Source: Wang et al., “Characterizing Barriers and Technology Needs in the Kitchen for…” Open ↗source: primaryLast updated: 2026-11-17

Problem statement

Ovens, microwaves, cooktops and fridges have moved from knobs and raised buttons to flat panels and touchscreens, and people who cook without sight lose the feel of the controls. In a 2023 study (a preprint) that watched 10 blind and low-vision people cook in their own kitchens (five visited at home, five watched over video), five stressed how hard it was to work appliances such as the oven or microwave. The researchers write that flat buttons and touchscreens remove "the tactile feedback from the traditional controls" and that with all information shown visually "there was no effective way" to confirm settings such as oven temperature. The usual fix is home-made: most participants stuck bump dots or braille on key buttons. But the dots "often fell off" and were "hard to distinguish when multiple tactile labels were used for different buttons." Research groups have built better fixes: a 2017 system that 3D-prints a tactile overlay for a flat panel from a photo, a 2019 system that guides blind users through dynamic touchscreens with a phone app and 3D-printed accessories, and a 2023 phone case that presses a touchscreen for the user. All three reported success in user studies, and all three were tested in the lab, not in homes. But the trainers who teach kitchen skills in the 2023 study mostly recommended low-tech tools, and the 2017 overlay's own authors say it would likely disrupt a capacitive touchscreen. The problem is a cheap, durable way for a blind cook to find and confirm the controls on the flat-panel appliance they already own.

Why this matters

Kitchen skills are part of vision rehabilitation, and the 2023 preprint study found that the cooking tasks trainers focus on were all among the major challenges its participants named. An appliance that cannot be read or confirmed by touch or sound is also a safety risk: the 2023 preprint describes a toaster lever that was not fully down, so the toast popped up without the cook knowing. Low-tech labels are what reaches people. The professionals interviewed said advanced devices were often too expensive, not covered by insurance, and needed charging and updating. One professional described flat electric cooktops where "we can't put any type of our traditional labels on the flat top surface because they will burn."

What’s been tried and why it hasn’t worked

(1) Bump dots and braille labels are the standard tool, taught in rehabilitation and used by most of the participants in the 2023 preprint. They fall off, and several dots on one panel are hard to tell apart. Capacitive panels add a second problem: they react to a touch, not a press, so feeling for a control can set it off. The American Foundation for the Blind writes that such panels are "generally inaccessible unless the surrounding area can be labeled with tactile markers such as bump dots," so that a user finds a marker and slides a finger to the control. A guest post on a personal vision-loss blog (supporting only) describes two home workarounds: the writer's own, to "place a couple of bump dots next to the capacitive control panel," and one other people have tried, to "cut out a cardboard template so the holes in the template allow only the bump dots to be touched"; the writer notes that "not all controls are near the edge of the panel," and once "accidentally put my oven into self-clean mode and the door locked." A peer-reviewed source reports the same hazard: in the StateLens paper's interviews with 16 blind people, one participant said that once in a few weeks she "would accidentally hit the settings button on her fridge's touchscreen panel" and then needed to call someone to come and check on it. The 2017 overlay paper adds that labelling usually "requires sighted assistance to identify the original functions and apply the labels." (2) Memorising and smart speakers. Some participants memorised button positions on panels that still had physical buttons. Two used a smart speaker to run appliances by voice. Neither works for a flat panel with no voice link. (3) 3D-printed overlays (Facade, CHI 2017). The blind user photographs the panel next to a dollar bill, crowd workers label the buttons, and a printer makes a layer of tactile, pressable buttons that is stuck on top. In a study with 11 blind participants it was viable: once fitted, the ten participants who used the braille version found microwave buttons with 97.3% accuracy, the two participants quoted on the comparison said they liked it better than their own labels, and it costs about $10. But the paper's own figures show the weak points. The app's image step produced a usable front view for 34 of 55 photos (61.8%), and 21 of those 34 gave a usable overlay model. Two of 11 participants failed to attach the overlay correctly. An early button set "fell off after several times of use" before the design was changed. And the authors write that if the overlay covers a capacitive touchscreen "it would likely disrupt operation of the interface," leaving that to future work. (4) Phone guidance for touchscreens (StateLens, UIST 2019). It rebuilds a touchscreen's screens from video, then guides the user by voice, with 3D-printed accessories so a blind user can explore without accidental touches. Its lab study, with 14 visually impaired participants using a simulated touchscreen coffee machine shown on a tablet, reports success, but the authors write that they "did not deeply study how StateLens works in the real world," and participants had trouble holding the accessories at some angles and activating the exact button. It depends on a phone and on a video model of each interface, and the 2023 trainers did not mention such tools. (5) Training and talking tools. Trainers in the 2023 preprint study recommended a talking thermometer, but the paper reports that no participant adopted it, because its feedback was slow (one who owned one judged food by touch instead). The trainers said they lacked time to keep up with new technology, so they mostly recommended low-tech tools. (6) A standard exists. IEC 63008:2020 gives accessibility requirements and guidance for control elements on household appliances "by older persons and persons with disabilities", with clauses on tactile markings and audible signals and an informative annex, "Requirements of touch-control elements for visually impaired users"; it excludes control by apps and speech. Only its record and preview were read, so how far it goes, and whether makers follow it, is not known here. In the European Union, the European Accessibility Act (Directive (EU) 2019/882) does not list household appliances among the products it covers (computers, self-service terminals, phones, TV equipment and e-readers). In the United States no rule requires it: a 2019 House bill (the GAIN Act, H.R. 3929) would have had the Access Board write a minimum nonvisual access standard for home appliances; its record ends at referral to a subcommittee on July 25, 2019. A 2021 House bill, the Medical Device Nonvisual Accessibility Act (H.R. 4853), would set nonvisual access standards only for Class II and Class III medical devices with digital interfaces, not appliances; its record ends at referral to a subcommittee on July 30, 2021. No later reintroduction of the GAIN Act was found. (7) A phone case that presses the screen (BrushLens, UIST 2023). A case with an array of touch actuators lets a blind user explore a touchscreen on the phone and have the case tap the chosen button. All six visually impaired participants did tasks they could not do before. But it was tested on a touchscreen monitor laid flat on a table to stand in for a kiosk, it assumes the system already knows the interface layout, 6 of 10 participants found it bulky, and several said it was too big for small panels such as printer controls. (8) Makers' sticker kits and overlays. These are already sold or given away. In 2024 GE Appliances began selling an "Access Kit" of more than 400 braille and tactile stickers, designed with the American Printing House for the Blind, for about $20; GE's own product page lists it at $19.99. A design trade report, quoting GE, says the stickers cover "the 80 most common settings across thousands of appliances" and go "directly over existing controls, allowing appliance buttons, knobs and other functions to be identifiable by touch"; the quoted description calls them durable but gives no test. LG's US support page takes requests for "a braille overlay for your appliance" or "tactile stickers for your appliance." Samsung gives braille stickers "free of charge upon request", but its Lebanon accessibility page lists them only for washer and dryer models from 2019 on. Amazon's help page describes a braille overlay, "a sticker, sized to exactly fit the appliance control area," for the AmazonBasics Microwave and the Amazon Smart Oven. A US state rehabilitation agency's resource guide lists braille overlays for Whirlpool appliances, free on purchase of a refrigerator, range, dishwasher, washer, dryer or microwave; the listing does not mention flat or touch panels, and Whirlpool's own pages could not be opened. The American Foundation for the Blind notes that such kits are "designed to fit specific appliance controls." It also writes that touchscreens and flat touch panels "are generally inaccessible to people who are blind or have low vision unless very specific conditions are met." None of the appliance makers' pages read says whether its stickers work on a capacitive touch panel, or how long they stay on. (9) A patent. US 8,633,907 B2 (inventor Padmanabhan Mahalingam, 2014), "Touch screen overlay for visually impaired persons," describes in its abstract a flexible overlay sized to "a touch screen of an electronics appliance," with "raised features and / or openings"; the background quoted in the record names touch screens on cellular phones, PDAs, music players and laptops, and a patent database lists it as inactive. Its claims (read at Google Patents) are for an overlay whose tactile features form "a single Braille pattern" used to enter characters into the device, not labels for an appliance's own buttons. (10) Small makers' tactile stickers and overlays. AccessWorld (January 2017) describes HALOS, the Home Appliance Label and Overlay System from Tangible Surface Research: custom transparent silicone overlays for touch-control appliance panels that use shapes instead of braille ($30 on Etsy), and foam stick-on tactile icon sets ($5 a set), some icon shapes designed by Rochester Institute of Technology students; the article reports no test of how long they stay on or how they behave on a capacitive panel, and whether they are still sold was not checked. Hable, a Dutch firm, sells Stactiles, tactile stickers for appliances; its page says "All Stactiles work on Touch screens," that they "remained intact after exposure to around 200°C for an hour" and show good resistance to detergent, "remaining attached through several dishwasher cycles," but it gives no test report and does not say whether they block or trigger a capacitive panel.

What would unlock progress

A marker or overlay that a blind cook can fit without sighted help, that stays on through months of wiping, that can be told apart by touch when there are many on one panel, and that works on a capacitive touch panel as well as on flat membrane buttons. It would have to cost about what bump dots cost, because that is what trainers recommend and what reaches homes. The research prototypes already solved parts of this (reading the panel, making the overlay, pressing a touchscreen through a phone). Makers already sell or give away fitted sticker overlays, so a new team should not re-make a printed sticker sheet. What the prototypes and the kits left unsolved is adhesion and durability in a real kitchen, a passive marker that works on capacitive touch panels (BrushLens presses them, but as a bulky phone-held device tested on a simulated kiosk; StateLens's 3D-printed finger cap and stylus let users explore a capacitive screen with few accidental touches, but they are held or worn rather than fixed to the panel, and were tested only in the lab), and a path that does not run through crowd workers or a 3D printer. The standard (IEC 63008) is a second lever: a team could check what it asks of new appliances against what blind cooks need.

How we’d know it’s being solved

(a) Blind or low-vision users set a common task (for example a 1-minute microwave setting) on a flat-panel appliance without sighted help, with fewer wrong presses and less time than with bump dots alone. (b) The marker is still in place and still readable after a set number of wipe-cleaning cycles, a bench test bump dots can be put through too. (c) On a capacitive panel, the overlay does not cause false or missed touches. (d) Cost per appliance close to a sheet of bump dots.

Where to start

Facility-free door (bench test, no partner): put bump dots and two or three alternative markers (shaped, textured, differently sized) through a repeatable wipe-and-press test on a flat membrane panel and on a capacitive touch sensor board, and measure how many survive and whether each causes false touches on the capacitive board. No appliance needs to be switched on, and no people are needed for this step. Object door (with reachable users): start from what exists and where each stops. Bump dots fall off and blur together when several are on one panel (in the 2023 preprint study), and on a capacitive panel users place them beside the controls, sometimes with a cardboard template, because feeling the panel can set off a command. Facade's printed overlay failed to attach for 2 of 11 users, and its authors expect it would likely disrupt a capacitive touchscreen. BrushLens presses a touchscreen for the user, but it is a bulky phone case tested on a simulated kiosk. Maker sticker kits and fitted overlays are already sold or given away (GE, LG, Samsung, Amazon), and small makers sell stick-on tactile icons and stickers (HALOS, Stactiles). No appliance maker's page read says its stickers work on capacitive panels or how long they stay on; Hable's page says Stactiles work on touch screens and survive heat and dishwasher cycles, but gives no test report. What is left open on this evidence is an independent test of whether such stickers trigger or block a capacitive appliance panel, and how long they stay on in kitchen use. Design a durable tactile marker or guide for a flat membrane or capacitive panel: one a blind user can fit alone, that feels different for each of the six or eight buttons that matter on a microwave or oven, and that does not itself trigger the panel. It differs from Facade in needing no crowd labelling or home 3D printer, and from the sticker products in coming with a test for false touches and wear on a capacitive panel. Fit and handle it first on an unpowered or child-locked appliance, and check for false touches on the bench door's capacitive sensor board, before any tester uses it on a live panel. Then test fitting and button-finding with blind and low-vision students or staff reached through a campus disability office, or with local residents reached through a local blindness organisation or vision rehabilitation service. Safety and access line: testers never operate a hot hob or oven with an unproven marker. Sessions are on cold appliances, unplugged or powered with nothing heating (setting the program, not cooking); the page's flat-cooktop quote is that labels on that surface burn. Sessions with blind and low-vision participants need campus ethics review, with consent materials in accessible formats. Design door: read IEC 63008 (through a library) against the barriers in the 2023 preprint study and write the gap list a standards committee or appliance maker could act on. Skills: product and materials design, embedded touch sensing, accessibility research.

Genes

Related problems

Stuck the same way, in other fields.

field: making & materialslab brine cooperates, field brine doesn'tDirect lithium extraction defeated by real brine chemistry variabilitytested in the wrong worldsource: primaryfield: digital & spaceigniting fuel in a thousandth of a secondScramjet engines struggle to stabilize flames at supersonic airflow speeds with sub-millisecond residence timestested in the wrong worldsource: primaryfield: making & materialsbuilding qubits that come out the sameQuantum devices work in early systems, but NSF calls for new fabrication approaches to make them precise, defect-controlled and reproducible at scaletested in the wrong worldsource: primaryfield: health & medicinefragile drugs, broken cold chainsCell therapies, vaccines, and blood products require unbroken cold chains that fail in the settings where they're most neededtested in the wrong worldsource: primary

Sources

  • Wang R, Zhou N, Nguyen T, Mondal S, Mutlu B, Zhao Y. "Characterizing Barriers and Technology Needs in the Kitchen for Blind and Low Vision People." arXiv:2310.05396v1 [cs.HC], 9 Oct 2023 (preprint, not peer-reviewed), accessed 2026-11-17. Link ↗
  • Wang R, Zhou N, Nguyen T, Mondal S, Mutlu B, Zhao Y. "Practices and Barriers of Cooking Training for Blind and Low Vision People." The 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '23), doi:10.1145/3597638.3614494 (peer-reviewed short paper on the same study's professional interviews; abstract), accessed 2026-11-17. Link ↗
  • Liang C, Iravantchi Y, Krolikowski T, Geng R, Sample A, Guo A. "BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation." The 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23), doi:10.1145/3586183.3606730 (author copy), accessed 2026-11-17. Link ↗
  • Guo A, Kim J, Chen XA, Yeh T, Hudson SE, Mankoff J, Bigham JP. "Facade: Auto-generating Tactile Interfaces to Appliances." Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 5826–5838, doi:10.1145/3025453.3025845 (accessible author copy), accessed 2026-11-17. Link ↗
  • Li FM, Liu MX, Kane SK, Carrington P. "A Contextual Inquiry of People with Vision Impairments in Cooking." CHI 2024, arXiv:2402.15108v1, accessed 2026-11-17. Link ↗
  • Guo A, Kong J, Rivera M, Xu FF, Bigham JP. "StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible." UIST '19, October 20–23, 2019, New Orleans, LA, USA, doi:10.1145/3332165.3347873 (ACM published version read in full, from a Wayback Machine copy; preprint arXiv:1908.07144), accessed 2026-11-17. Link ↗
  • IEC 63008:2020, "Household and similar electrical appliances – Accessibility of control elements, doors, lids, drawers and handles" (record; publisher preview with scope and contents), accessed 2026-11-17. Link ↗ Link 2 ↗
  • H.R. 3929, 116th Congress, "Greater Access and Independence through Nonvisual Access Technology Act of 2019" (GAIN Act), introduced July 24, 2019 (text; status), accessed 2026-11-17. Link ↗ Link 2 ↗
  • Groux C. "GE Access Kit brings Braille and tactile labels to appliances." Reviewed, March 12, 2024 (trade press, supporting only), accessed 2026-11-17. Link ↗
  • US 8,633,907 B2, "Touch screen overlay for visually impaired persons" (claims and legal status), accessed 2026-11-17. Link ↗
  • Oklahoma Department of Rehabilitation Services, resource guide entry "Whirlpool Corporation" (archived copy of 2025-06-28; supporting only), accessed 2026-11-17. Link ↗
  • Noe R. "GE's Access Kit Lets You Easily Retrofit Appliances for Use by the Blind." Core77, October 22, 2024 (trade press), accessed 2026-11-17. Link ↗
  • GE Appliances, "Access Kit - Braille & Tactile Stickers" (product page), accessed 2026-11-17. Link ↗
  • LG USA Support, "Accessibility Help: Customer Service" (support page), accessed 2026-11-17. Link ↗
  • Samsung Lebanon, "Accessibility - Home Appliances" (regional page), accessed 2026-11-17. Link ↗
  • Amazon, "Applying Your AmazonBasics Microwave and Smart Oven Braille Keypad Overlay" (help page), accessed 2026-11-17. Link ↗
  • American Foundation for the Blind, "Appliance Accessibility: Design Features That Support Blind and Low Vision Users" (undated), accessed 2026-11-17. Link ↗
  • Directive (EU) 2019/882 of the European Parliament and of the Council of 17 April 2019 on the accessibility requirements for products and services (European Accessibility Act), accessed 2026-11-17. Link ↗
  • H.R. 4853, 117th Congress, "Medical Device Nonvisual Accessibility Act of 2021," introduced July 29, 2021 (text; status, read in the archived copy of 2026-03-11), accessed 2026-11-17. Link ↗ Link 2 ↗ Link 3 ↗
  • Rose D. "Appliances: Resistive versus Capacitive Touch Controls, Guest Post by Doug Rose." Vision Loss and Personal Recovery, April 12, 2021 (personal blog guest post; supporting only), accessed 2026-11-17. Link ↗
  • Holton B. "VizLens and HALOS: Making Touchscreen Appliances and Other Devices More Blind Friendly." AccessWorld, January 2017, American Foundation for the Blind, accessed 2026-11-17. Link ↗
  • Hable, "Stactiles" (vendor product page), accessed 2026-11-17. Link ↗

Also cited in the brief

  • Preece A. "AccessWorld Survey of Appliance Accessibility in 2025 for People who are Blind or Have Low Vision." AccessWorld, Winter 2025. Link ↗
Revision notes

This brief gets checked against its sources and contains the following revisions. Future revisions get added here.

Worth knowing

  • the in-home observations come from one study that is still a preprint, not peer-reviewed
  • the only claim that a tactile sticker works on touch screens is the seller's own statement, with no test report

Full check

Sources read

  • Wang et al., barriers and technology needs in the kitchen for blind and low-vision people (arXiv preprint, 2023): full text
  • Wang et al., cooking training for blind and low-vision people (ASSETS short paper, 2023): abstract only
  • Guo et al., Facade tactile overlays for appliances (CHI, 2017): full text
  • Liang et al., BrushLens touchscreen actuator (UIST, 2023): full text
  • Guo et al., StateLens (UIST, 2019): full text
  • Li et al., contextual inquiry of cooks with vision impairments (CHI, 2024): full text (methods and background read; cited only for background)
  • IEC 63008:2020, accessibility of household appliance controls: record only (with the publisher's preview of the scope and contents)
  • US House bills H.R. 3929 (2019) and H.R. 4853 (2021): full text (bill text and status records)
  • Reviewed and Core77, articles on GE's Access Kit (2024): full text
  • GE Appliances, Access Kit product page: full text
  • LG, Samsung (Lebanon) and Amazon accessibility and help pages: full text
  • American Foundation for the Blind, appliance accessibility page and AccessWorld survey (2025): full text
  • European Accessibility Act, Directive (EU) 2019/882, Article 2: full text
  • US patent 8,633,907, touch screen overlay for visually impaired persons: full text (claims and legal status)
  • Rose, guest post on resistive and capacitive touch controls (personal blog, 2021): full text
  • AccessWorld, VizLens and HALOS (2017): full text
  • Hable, Stactiles product page: full text
  • An et al., digital appliance accessibility study; TapNav: abstract only (not cited on the page)
  • Guo and Bigham, tactile overlays (IEEE Pervasive Computing, 2018); Touchplates (ASSETS, 2013): record only (not cited on the page)

What changed

  • Not found in the sources, replaced with what they say: five participants were said to stress how hard the oven or microwave was; the study says advanced kitchen appliances, giving the oven and microwave as examples, and the page now says so.
  • Stated more strongly than the source: StateLens's finger cap and stylus were said to let users explore a touchscreen without accidental touches; the study counted a few, so the page now says few.
  • Contradicted by the source, corrected: the phone-case system was said to use a ring of actuators and to have been tested on a kiosk; the paper describes an array of actuators, tested on a touchscreen monitor laid flat to stand in for a kiosk.
  • Numbers: the 97.3% button-finding accuracy for the printed overlay is now given for the ten participants who used its braille version, as the paper reports it, not for all 11.
  • Entry points: the product-design starting point now begins from these sticker products as well, and says the open question is an independent test of whether such stickers set off or block a touch panel and how long they last in kitchen use.
  • Other: the patent's claims were read: they cover an overlay for typing characters into a touchscreen device, not labels for an appliance's own buttons, and the page now says so; two small makers' tactile sticker products were added to what has been tried; neither page gives a test of how they behave on a touch panel or how long they stay on.

Left open

  • what IEC 63008 requires clause by clause (only its record and preview could be read)

Separate check of specific claims: A peer-reviewed account of a blind cook setting off a fridge's touch panel by accident and a state agency's listing of free Whirlpool braille overlays were added, and citations were added to the source list.

Earlier full check: Several statements were brought in line with the sources: how the study's cooks were observed, that all three research systems were tested in the lab, how the trainers' focus matched the cooks' challenges, who wrote a blog post's two workarounds, what the StateLens study tested, and the StateLens citation; the main study is now labelled as a preprint wherever the page leans on it.

Separate check of specific claims: Makers' braille and tactile sticker kits, a patent, the European accessibility law's scope, a later US bill and the problem that touching a touch panel can set it off were added, and the product-design starting point now begins from touch panels and durability.

Separate check of specific claims: The product-design entry point was rewritten to start from the existing fixes and where each stops, and a safety and access line was added: testing on cold appliances only, never a hot hob or oven, and ethics review for sessions with blind and low-vision participants.

Earlier full check: The long title was softened to the overlay authors' own words ('would likely disrupt' touchscreens) with the display title unchanged, the main study is now marked as a preprint, a phone-case touchscreen system and GE's sticker kit were added, the overlay study's positive results were added, and a sentence about a talking thermometer was corrected.