Monday, June 17, 2013

Glass for Captioning: First Field Tests

Glass for Captioning series:

Augmented Reality Captioning
Preliminary Impressions of Google Glass

First Field Tests

Last week I tried Google Glass out in the field for the first time. I've gotten a new pair now; Google was very helpful and accommodating when I told them about the optical flaw in my last pair and happily switched them out for a new one. There's still a little bit of glare underneath the screen, which they told me is pretty much inherent to the design, but it's much less than before, and the glare along the sides is gone, plus the smeary left edge has cleared up and the text overall seems crisper and less diffuse than before. I think my prior set just had a slightly misaligned projector or something. Absolute top scores to Google's customer service team, which was communicative, timely, and quick to move.

There are still some frustrations when it comes to actually using Glass for captioning. Initial tests seemed to offer Hangout Screen Sharing as a good solution; the resolution was clear enough that about 8 lines of captioning were visible, very readable, with all of my carefully tweaked Eclipse display and font options on view, plus it would allow me to use all the realtime editing tricks I rely on every day to clean up misstrokes and define new words from my steno machine. It sounded like a slam dunk. When I was just writing a few experimental words for myself, it seemed perfect. Unfortunately, as I feared, when I started actually transcribing the professor in action, the amount of lag involved in refreshing an entire computer screen several times a second quickly tanked the experiment. This was a particularly slow and steady lecturer, but the display was consistently 10 to 20 lines behind my laptop's display, and sometimes it would skip whole swaths of texts in order to catch up to the present, only to fall immediately behind again. So much for that idea. Incidentally, my laptop was on good quality institutional Wi-Fi, and Glass was tethered via Bluetooth to my phone, using the connection from that same institutional Wi-Fi. Glass can connect to most Wi-Fi networks directly, but this particular one required an authentication type that wasn't supported, so it had to piggyback from the connection on my phone. I've also had some trouble connecting it to my 4G hotspot, but I want to fiddle with it some more before deciding whether it's Glass's fault or user error.

So the next day I gave up the beautiful dream of lagless screen sharing and went to the fallback option: Hangout Chat. I set it up well before the class started, which was good, because currently Glass offers no way to turn off the little blips, bloops, swoops, and blats it makes while connecting to someone via Hangout. I really hope they offer a silent option soon; the bone conducting speaker makes the sound louder to the user than to anyone else in the room, but it's still clearly audible and potentially quite disruptive. By default, Glass displays video from whoever you're hanging out with, but I turned that off to save Glass's battery. So then it displayed my user icon, but that was a distracting background against which to view the text, so I set my user icon to a plain black rectangle. Then I muted Glass's own microphone and camera, also to save on battery life. This is what I wound up with:



The Hangout Chat interface without text.



The Hangout Chat Interface with text.

The two main distractors are the prefix of my username before every line of text that's sent (inescapable in this sort of text chat format) and the two prominent "camera muted" and "microphone muted" icons in the center of the lowest part of the screen. I think this is somewhat poor design, considering that new text starts at the bottom and is pushed upward, and that the very top of the screen isn't used by Hangout Chat at all. So rather than keeping the mute icons down at the bottom, interfering with the newest and presumably most important texts, why not put them at the top and out of the way?

The battery was also a little disappointing. On the previous day, when I was screen sharing, it died completely after less than an hour. That was too bad, but I had higher hopes for Hangout Chat, which presumably required less juice. And indeed, its total life was about an hour and 40 minutes, but the intensely irritating low battery alert came on just about exactly halfway through:




So not only does the alert pop up when the battery's presumably only at 50% of its capacity, but the alert is an entire line of full-sized text smack in the middle of the screen. How does that make sense? What's wrong with a discreet little battery icon tucked away in the corner of the screen? I can only hope that as the UI is updated (which happens on a pretty regular basis, I'm happy to say), this will be fixed to be less disruptive. I'll also probably post a comment to the Glass Explorers' Forum. This is, as I have to keep reminding myself, a prototype device, and a lot can change over the next few months.

But here's the most serious issue, which you can also see in the pictures above: Once an old line of text is pushed up to make room for a new one, it's suddenly severely truncated. So if you didn't manage to read the entirety of the text the first time around, it's going to be all but useless to you as soon as another line comes in. For captioning, where text can come in at a pretty solid clip, that is a big, big problem.




This is the main thing that's keeping me from enthusiastically offering Glass to my clients. If all they've got to work with is one line of text, it won't be good for much except slow-paced one-on-one conversations, and if the battery is really only good for less than two hours (I haven't yet tested it with the microphone active, which would presumably reduce the battery life even more, even though it would potentially allow them to interact and even move around without me and my machine having to sit there at their elbow), that severely restricts the circumstances in which Glass will actually be useful.

What about the future? Will Screen Sharing get less laggy? Will they remove the truncation from previous messages? Will they show the username the first time a message is sent and then allow it to be implied for subsequent messages? Will they condense alerts to icons and move them out of the way? Or will I have to commission special captioning Glassware to solve all these problems for me? I guess we'll have to wait and find out.

Oh, and one last thing. By request, a picture of me actually wearing Glass. Dork Factor: Significant.

26 comments:

  1. Very helpful review. Looks like it would help to be able to set up an abbreviated nickname for use with Google Hangouts.

    By the way, I think you used the word microphone here incorrectly: "the bone conducting microphone makes the sound louder to the user..." You're referring to the "speaker," I think, which takes the place of earbuds in Google Glass. How does Google refer to this component?

    Note that people with hearing loss would need a telecoil accessory or another means of coupling Google Glass with their hearing aid or CI so that they can hear as well as possible and use captioning at the same time. I haven't heard of any user of Google Glass making this suggestion, however.

    ReplyDelete
  2. Good catch! I fixed it. Thanks for letting me know! (':

    ReplyDelete
  3. Open Method Properties for quick usage of essential process facts and inbound links to other valuable program resources. screenshot on windows 7 hp elitebook Windows 10 app: Cortana Cortana is the new personal assistant included with Windows 10. Cortana will let you look for the online, come across points on your own Laptop, and keep an eye on your calendar.

    Using multiple desktops In Windows 10, you can produce customized desktops to arrange your apps in groups that work best for you. To add a desktop, click Task View , and then click New desktop.

    ReplyDelete
  4. This article is an appealing wealth of informative data that is interesting and well-written. I commend your hard work on this and thank you for this information. You’ve got what it takes to get attention.
    Textured Glass Windows

    ReplyDelete
  5. I am very happy to read this article, you have mentioned great information in your article post. Wonderful article post

    fused silica substrate

    ReplyDelete
  6. The only thing you need personal loans is Internet access and 5 minutes to fill in an application form, which is rather simple even if you don’t communicate with information 200 guaranteed approval payday loans technologies well.

    ReplyDelete
  7. In 1776, Scottish economist and philosopher, Adam Smith wrote the masterpiece, 'The Wealth of Nations'. In this piece, I explain the new rule of Technology of Nations. personal development

    ReplyDelete
  8. Denise Robbins, a software engineering manager by day, integrates her knowledge of computers and technology into all her techno-romantic thriller novels. Her published works include It Happens in Threes and Killer Bunny Hill with Connect the Dots and Never Tempt Danger scheduled for release in 2010. self help

    ReplyDelete
  9. In 1776, Scottish economist and philosopher, Adam Smith wrote the masterpiece, 'The Wealth of Nations'. In this piece, I explain the new rule of Technology of Nations. self help

    ReplyDelete
  10. In 1776, Scottish economist and philosopher, Adam Smith wrote the masterpiece, 'The Wealth of Nations'. In this piece, I explain the new rule of Technology of Nations. Buy antminer online

    ReplyDelete
  11. In 1776, Scottish economist and philosopher, Adam Smith wrote the masterpiece, 'The Wealth of Nations'. In this piece, I explain the new rule of Technology of Nations. Rust classes

    ReplyDelete
  12. Business is a tough game. Continually we need to operate in three areas to ensure we produce consistent outcomes. The businesses we work with are challenged to: Picuki

    ReplyDelete
  13. Technology is the leader of the enterprising world. And it leads using a constitution. Unlike the traditional political structure, this constitution is Algorithms written by engineers, scientists, etc and not congressmen and politicians. German government

    ReplyDelete
  14. Advancement in technology has made the world go "gaga". As far as technology is concerned, you can expect the unexpected or imagine the unimaginable. The world has left the stage of crude implementation. Every facet of life has been touched and affected by technology. The bewilderment of everyone is that existing technologies are fast becoming obsolete by the day; courtesy of advancement in technology... Pastel software Sales, Support

    ReplyDelete
  15. While some plan for home improvement to add value to their house, others simply pursue a more luxurious and comforting lifestyle. Home improvement projects may need different levels of investment depending upon their scales. pg glass windscreen prices

    ReplyDelete
  16. There are many popular home improvements that people constantly want or need. However, these improvements normally don't come cheap, causing many people to turn to home improvement loans in order to make their dreams come true. Whether it's to buy a new conservatory, dream kitchen, modern bathroom or maybe to have a garage built. windscreen replacement johannesburg

    ReplyDelete
  17. Real estate offices are closing all over the country. Real estate agents are hanging up their licenses in every state. The traditional bricks-and-mortar real estate brokerage is hemorrhaging, and all that keeps this archaic business model alive is consolidations. As offices close, some agents quit, but the survivors move their licenses to another sinking ship, a ship that looks just like the last one and often with the exact same name on the bow. There is an answer, and it means embracing technology, new marketing methods, new tools to reach clients, and mastering the Internet as a powerful medium. property for sale

    ReplyDelete
  18. Ideas, Ideas, Ideas, Ideas, Ideas! That's what this report is all about. This series of related real estate tales is written specifically to get your motor running and your wheels turning. property for sale

    ReplyDelete
  19. Best Casinos in the World (2021) - Mapyro
    Best 나주 출장안마 Casino in the World (2021) · 고양 출장안마 Golden Nugget – $50 · Beau 전주 출장마사지 Rivage Casino Resort & Spa – $25 · Casa Grande Casino 창원 출장샵 Resort & Spa 동두천 출장안마 – $

    ReplyDelete
  20. Do you want to increase your return on investment (ROI) on technology projects? This article explains how driving effective user behavior is key to maximizing technology ROI. It examines typical IT implementation practices and provides a vision for how we can improve ROI by changing how we approach projects. This is a must read article for anyone who wants to increase the success of their IT projects! Buy antminer online

    ReplyDelete
  21. Without a doubt, technology is all around us. Technology is a major part of our everyday lives and it is hard to imagine living in a society that does not have advanced technology. The affect that the current technological advances continue to have on our lives grows more positive with every new "thing" that comes out. heating system repairs Magnolia

    ReplyDelete
  22. Batteries are the energy source used in many of our day to day electronic products. If you stop and think about it, batteries run calculators, cameras, pencil sharpeners, computers and yes, even buses, trains, and satellites. Without the right battery, life could come to a standstill. 100Ah LiFePO4 Battery

    ReplyDelete
  23. With today's technologies and the increasing demand for a wider variety of services, are Web hosting providers pricing their programs competitively to remain in today's market? Web hosting has advanced into a collection of multifaceted specialized categories from shared hosting to dedicate hosting. Also, hosting has always been driven by a growing customer's demand and advances in the latest technology. landingpageformoresales

    ReplyDelete