Tuesday, September 14, 2010

Technical Accuracy and Semantic Accuracy

It's been a few days since I posted the video of my CART demo. If you've seen it, its subject material has probably gotten fairly hazy in your mind by this point. If you haven't seen it, don't watch it yet. For the record, the audio used in this excerpt was of very good quality, a single speaker with a standard American accent and clear diction, speaking at a rate of approximately 160 words per minute. First, read this transcript, created by YouTube's Autocaptioning software.

"for implants support and you know as I haven't said anything about biology those folks didn't really need to be educated and genetics biochemistry more about it so about the to solve those problems and that's because biology as it used to be was not a science that engineers could addressed very well because in order for engineers really analyze study quantitatively develop models at the bill technologies all for the parts there's a lot of requirements on the science that really biology that that's why %um %um the actual mechanisms a function work understood yes you could see that moving your arm requires certain force in of would where certain load we really didn't know what was going on down in the proteins and cells and tissues of the muscles on the books okay but still you could decide maybe an artificial %uh to do this %um %uh in the plan you really know the molecular compliments so how the world he actually manipulate the system he didn't even know what the molecules work they're really underlying yes you couldn't really do the chemistry on the biological all %uh it's very hard to quantify you can even though the parts of the mechanisms how could you get quantitative measurements for them develop models so there's good reason why they're never really was a biological engineering until very recently while he wasn't the science that was released soon right here in dallas so there for the world biomedical engineering bailey although the deposition prompted it just talked about that that necessarily require miles per se but that's changed the good news for you folks is biology this change it's now a science that engineers had it been that to very well"

Okay. Now, based on the above, I'm sure you were able to get the very general gist of the subject the professor was talking about, but if you were a student, sitting in class at an expensive, prestigious private institute of technology, and the paragraph above was the only access you were given to what the professor was saying, how would you feel about it? What if I told you that "at the bill technologies" was actually "and to build technologies", "muscles on the books" was actually "muscles and the bones", "the world biomedical engineering bailey although the deposition prompted" was actually "the world of biomedical engineering mainly involved all these application problems", and "released soon right here in dallas" was actually "really suited for engineering analysis and engineering synthesis"?

Here's the actual transcript of the excerpt:

"Or implants and so forth. And you notice I haven't said anything about biology. Those folks didn't really need to be educated in genetics, biochemistry, molecular biology, cell biology, to solve those problems. And that's because biology, as it used to be, was not a science that engineers could address very well. Because in order for engineers to really analyze, study, quantitatively develop models, and to build technologies, alter the parts, there's a lot of requirements on the science that really biology didn't satisfy. The actual mechanisms of function weren't understood. Yes, you could see that moving your arm required a certain force, and would bear a certain load, but you really didn't know what was going on down in the proteins and cells and tissues of the muscles and the bones. Okay? But still you could design maybe an artificial bone to do this. An implant. You didn't really know the molecular components, so how in the world could you actually manipulate the system, if you didn't even know what the molecules were, that are really underlying this? Okay? You couldn't really do the chemistry on the biological molecules. It's very hard to quantify, since if you didn't even know the parts and the mechanisms, how could you get quantitative measurements for them, develop models? So there's good reason why there never really was a biological engineering until very recently, because biology wasn't a science that was really suited for engineering analysis and engineering synthesis, and so therefore the world of biomedical engineering mainly involved all these application problems that I just talked about, that didn't necessarily require biology per se. But that's changed. Okay? The good news for you folks is biology has changed. It's now a science that engineers can in fact connect to very well."

My unedited realtime CART output had one error (I wrote "that didn't really require biology" instead of "that didn't necessarily require biology"), giving me an accuracy rating of 99.67%. I would argue that it gave me a semantic accuracy rating of 100%, since "necessarily" and "really" are more or less synonyms. YouTube's autocaptions, graded only on words it got right (not penalizing it for extra wrong words added), got 213 out of 299 words correct, for an accuracy rating of 71.24%. The big question is: What's its semantic accuracy rating?

If all you had to go on was the autocaptions, how useful would you find them, and how much meaning could you extract from the 71% that was correct? Keep in mind that you wouldn't have any external guidance as to which parts were correct and which parts were erroneous. Would you rate this transcript as "worthless", "better than nothing", "pretty good", or "quite useful"? Do you feel that a 71% technical accuracy rating translates to 71% of meaning transmitted and understood? Or do you feel that the scattered and jumbled effect of the machine translation interferes with understanding more severely than the 29% error rate would suggest?

A few caveats: I'm not addressing voice writing here. Independent machine translation and operation of voice recognition software by purposefully dictating or respeaking humans are two very different things. I also recognize that YouTube's autocaptions are not as advanced as those produced by other speaker-independent VR software out there. The main point of this post is to look at the difference between technical accuracy and semantic accuracy. I'd like to do it again sometime with automated software that boasted a technical rating of 90% or more; then I think the difference between technical and semantic accuracy would come out into even starker relief. Remember, 90% accuracy means one word out of every ten is incorrect. But this is the technology I've got available at the moment, so I welcome the input of everyone reading this blog. How useful do you find transcripts like this? Can you put a percentage on it? I'm really looking forward to reading the comments, so I hope a lot of people weigh in.

58 comments:

  1. This is an awesome blog. I am a closed captioner and was thinking about providing CART services because of the cut in captioning rates. I stumbled upon your blog from Linked In.

    I don't think the public realizes how poor a translation rate is at 90%. Anything below 98% is hardly usable, and a good captioner/cart provider should provide at 99% and above consistently.

    If a student is paying the huge tuition fee it costs to attend college, as the parent footing that bill, I would be very upset to think this is what my hearing-impaired child had to use. I know this is a youtube translation, but really, it's just not that uncommon to see poor captions. I almost hate to tell anyone I closed caption for television because I know I am going to get the usual comment, "Boy, you should have seen those horrible captions on the(fill in blank) show the other night."

    It gets old when you consider yourself a professional and yet you find yourself more times than not trying to defend the indefensable. Sort of like the direction our country is headed. But that's a debate for another day.

    Thanks for this post. I will be tagging it on Facebook.

    Educating the public is a good starting point.

    ReplyDelete
  2. Hi, Lorilyn! Thanks for the kind words. I absolutely agree that many people realize what the numbers really mean in terms of translation quality. 98% is far below an acceptable standard, but often people think 90% or 95% are "good enough", when really they're absolutely unreadable and even downright misleading.

    ReplyDelete
    Replies
    1. Obviously I meant "many people don't realize", not "many people realize".

      Delete
  3. I'm a speech technology researcher in my grad school program, and I found your blog due to the Geek Feminism post about Plover (via Erin McKean).

    I'm actually writing my dissertation (due in a month! so I'm procrastinating here!) on looking at grammatical structure to try to improve the error-metrics that speech recognizers use -- a big part of the problem you're identifying is that the machine transcriptions are graded on word error rate (not a semantic or even a syntactically-oriented measure). This stuff is fascinating to me.

    Your performance, of course, is much much better than the machine's, regardless of how you measure it, but I'm glad to see people who care about the details start to ask questions about the metrics (from the partially-automated perspective, rather than fully-automated).

    ReplyDelete
  4. Wales Publications is a research publishing solution provide best Publication Research In UK
    in all issues from research to the journal publication are catering in your discipline based on your requirements.

    ReplyDelete
  5. Roku is a streaming device, which is a reasonable roku activation and other Set-up Box. Roku is a bundle of amusement, where client can stream for boundless motion appears, web arrangement, news, animation and a lot more projects.

    ReplyDelete
  6. The HBO Go is one distinctive channel and it is being used by millions of people. Enter the hbogo activation code at hbomax.com/tvsignin to complete the hbogo activation process. This can enable the subscribers to stream video on demand selections of HBO content that includes default and past series, films, sports using HBO site hbomax.com/tvsignin . You can visit this website hbomax.com/tvsignin to get more information about HBO Go.

    ReplyDelete
  7. Download the HBO Max App. To download this you can go to this link hbomax.com/tvsignin and sign in with your existing HBO email and password, choose all access to HBO Max, and start streaming immediately. To do this you can go to the hbomax.com/tvsignin page. If you already have HBO if you subscribe to HBO through one of the providers below, then you get access to HBO Max (at no additional cost). You can visit hbomax.com/tvsignin to get more information.

    ReplyDelete
  8. Download the HBO Max app and go to hbomax.com/tvsignin to activate it. And you can subscribe through the following App Store. Amazon Appstore Apple App Store Google Play Samsung TV etc. HBO Max is available on the following TV services. Go to the hbomax.com/tvsignin site to provide the activation code. Visit our website hbomax.com/tvsignin for more information.

    ReplyDelete
  9. HBO Max is a stand-alone streaming platform that connects HBO's TV favorites, blockbuster movies, and family to the new Max Originals. Such as Stream Friends, Looney Tunes Cartoons, Wonder Woman, Studio Ghibli Collection and more. HBO is the streaming option for all series, including original series, movies, specials and more. To sign in to Hbomax, you can go to the link hbomax.com/tvsignin provided by us and enter the hbogo activation code at hbomax.com/tvsignin to complete the Hbogo activation process. To know more about it, you can visit our website hbomax.com/tvsignin and get information.

    ReplyDelete
  10. Hbomax is the streaming option for all series, including original series, movies, specials and more. To sign in to Hbomax, you can go to the link hbomax.com/tvsignin given by us and enter the hbogo activation code at hbomax.com/tvsignin to complete the Hbogo activation process. To know more about this, you can visit our website hbomax.com/tvsignin and get information.

    ReplyDelete
  11. The HBO Go is one distinctive channel and it is being used by millions of people. Enter the hbogo activation code at hbomax.com/tvsignin to complete the hbogo activation process. This can enable the subscribers to stream video on demand selections of HBO content that includes default and past series, films, sports using HBO site hbomax.com/tvsignin . You can visit this website hbomax.com/tvsignin to get more information about HBO Go.


    Download the HBO Max App. To download this you can go to this link hbomax.com/tvsignin and sign in with your existing HBO email and password, choose all access to HBO Max, and start streaming immediately. To do this you can go to the hbomax.com/tvsignin page. If you already have HBO if you subscribe to HBO through one of the providers below, then you get access to HBO Max (at no additional cost). You can visit hbomax.com/tvsignin to get more information.

    ReplyDelete
  12. HBO Max is a stand-alone streaming platform that connects HBO's TV favorites, blockbuster movies, and family to the new Max Originals. Such as Stream Friends, Looney Tunes Cartoons, Wonder Woman, Studio Ghibli Collection and more. HBO is the streaming option for all series, including original series, movies, specials and more. To sign in to Hbomax, you can go to the link hbomax.com/tvsignin provided by us and enter the hbogo activation code at hbomax.com/tvsignin to complete the Hbogo activation process. To know more about it, you can visit our website hbomax.com/tvsignin and get information.

    ReplyDelete
  13. Activate your norton setup Enter the product key in the norton setup. Norton antivirus download, it is necessary to restore the norton product key which we can know by going to norton.com/setup . And can activate their norton.com/setup product key. norton provides you with norton.com/setup step guide for product key download and installation of norton antivirus.

    ReplyDelete
  14. The need for a reliable antivirus like Norton Enrollment is increasing, you can download it by visiting the website norton.com/setup . Not only companies as a measure of data security, but everyone is now relying on antivirus programs that can be found on the norton.com/setup with product key page. If you have any problem you can visit our website norton.com/setup and get help.

    ReplyDelete
  15. Norton Antivirus provides protection from viruses, malware, online threats without harming device performance. It also blocks harmful websites. You can get norton.com/setup product from retail store and also download and install Norton Antivirus with product key from norton.com/setup . And to do this, you can visit the website given by us at norton.com/setup or link. Our entire team is available to help you.


    Log in to the Norton website norton.com/setup to get the Norton Product Activation Key. You can select Norton service at norton.com/setup for which you need a product key. You can find it under the My Subscriptions tab. Safely copy and note the given product activation key. You can get information by visiting our website norton.com/setup . Norton Antivirus has many features and benefits for you.

    ReplyDelete
  16. Bet365 is the world's favorite online sports betting company. It provides you with the most comprehensive in-play service. You can also watch live sport on bet365. To login in it you can go to - bet365 login . Touch ID, Face ID and Fingerprint login in the Bet365 app allows you to securely and securely login to Bet365. To login to Bet 365, go to its member area " bet365 login "and follow the instructions on the password page. You can visit our website " bet365 login " to get more information about it.

    ReplyDelete
  17. It is very easy to open a Bet 365 account. For this you have to follow the steps given by us on the bet365 login which will be requested to you during this bet365 registration process. You can visit our website " bet365 login " to login to bet365. Undoubtedly one of the best cricket betting sites in the world. You can visit our website " bet365 login " to get more information about it.



    Bet 365 is one of the best sportsbooks in the betting industry. Reputation, huge betting selection and excellent customer service help this site stand out from the crowd. How to open a bet365 login account in an easy way. Let's get started with bet365 registration! You can visit our website " bet365 login " to get more information about bet365 and to access the bet365 login page.

    ReplyDelete
  18. Bet 365 is an international betting company and one of the oldest online resources created for betting. To access the bet365 login page, if you are new, you need to know more about Bet 365's bet account. You can visit our website " bet365 login " to get more information about Bet365 and access the bet365 login page.

    ReplyDelete
  19. Bet365 is an international betting company and is one of the oldest online resources created for betting. To access bet365 login page, you need to know more about bet365 bet account if you are new.

    ReplyDelete
  20. Skybet is the sports betting division of Betting & Gaming, a wholly owned subsidiary of British Sky Broadcasting Group plc (Sky). It has been a proud sponsor of the entire English Football League for 5 years. You can visit the Sky bet login page to get more information about it.

    ReplyDelete
  21. Melbet conducts a variety of events for LIVE betting on ice hockey, football, basketball and other popular sports. Melbet is a stable and reliable partner for all sports fans. To login on Melbet, you have to click on the melbet login button at the top of the site home page and enter your password, username information. Therefore, we will try to meet the needs of every customer.

    ReplyDelete
  22. The Canon printer enhances scan functionality, and includes a robust security feature set. Using a Canon printer service phone, you can get a full installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver. To get more and more information, visit our website canon.com/ijsetup and get the information according to convenience .

    ReplyDelete
  23. The Canon IJ Network Tool is a free application that allows you to set, view, or configure the printer's network settings that are connected through the network. For more information about this, you can visit our website canon.com/ijsetup . And using the Canon printer service phone, you can get the complete installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver.


    Download the Canon printer from canon.com/ijsetup and set it up on your device. Canon printers are all in one printer that facilitates print, copy and scan. And to download Canon ijsetup printer drivers you can visit our website canon.com/ijsetup . Canon printers are designed for personal and business use. To learn more about Canon printers, visit our website canon.com/ijsetup and take advantage.

    ReplyDelete
  24. Using a Canon printer service phone, you can get a full installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver. To get more and more information, visit our website canon.com/ijsetup and get the information according to convenience .


    Canon printer is the best printer out of all printers. Which allows for the best print, copy and scan. Canon printers are designed for personal as well as commercial use. You can visit the canon.com/ijsetup website to download the Canon printer driver. To get rid of any type of problem related to Canon printers, you can contact our team at canon.com/ijsetup . For more information about Canon printers, you can visit canon.com/ijsetup and get the information as per your convenience.

    ReplyDelete
  25. You can visit the canon.com/ijsetup website to get information about Canon Multifunction Printers, Canon Printers Dealers, Retailers, Stores and Distributors. Download the driver or software for the printer scanner. To install your additional Canon driver or software, go to the canon.com/ijsetup link and follow the steps on it. To get more information about it, visit our website canon.com/ijsetup and enjoy.


    The Canon printer enhances scan functionality, and includes a robust security feature set. Using a Canon printer service phone, you can get a full installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver. To get more and more information, visit our website canon.com/ijsetup and get the information according to convenience .

    ReplyDelete
  26. The Canon IJ Network Tool is a free application that allows you to set, view, or configure the printer's network settings that are connected through the network. For more information about this, you can visit our website canon.com/ijsetup . And using the Canon printer service phone, you can get the complete installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver.

    ReplyDelete
  27. Using a Canon printer service phone, you can get a full installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver. To get more and more information, visit our website canon.com/ijsetup and get the information according to convenience .

    ReplyDelete
  28. Download the Canon printer from canon.com/ijsetup and set it up on your device. Canon printers are all in one printer that facilitates print, copy and scan. And to download Canon ijsetup printer drivers you can visit our website canon.com/ijsetup . Canon printers are designed for personal and business use. To learn more about Canon printers, visit our website canon.com/ijsetup and take advantage.

    ReplyDelete
  29. Canon printer is the best printer out of all printers. Which allows for the best print, copy and scan. Canon printers are designed for personal as well as commercial use. You can visit the canon.com/ijsetup website to download the Canon printer driver. To get rid of any type of problem related to Canon printers, you can contact our team at canon.com/ijsetup . For more information about Canon printers, you can visit canon.com/ijsetup and get the information as per your convenience.

    ReplyDelete
  30. You can visit the canon.com/ijsetup website to get information about Canon Multifunction Printers, Canon Printers Dealers, Retailers, Stores and Distributors. Download the driver or software for the printer scanner. To install your additional Canon driver or software, go to the canon.com/ijsetup link and follow the steps on it. To get more information about it, visit our website canon.com/ijsetup and enjoy.


    The Canon printer enhances scan functionality, and includes a robust security feature set. Using a Canon printer service phone, you can get a full installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup . To get more and more information, visit our website canon.com/ijsetup and get the information according to convenience .

    ReplyDelete
  31. The Canon IJ Network Tool is a free application that allows you to set, view, or configure the printer's network settings that are connected through the network. For more information about this, you can visit our website canon.com/ijsetup . And using the Canon printer service phone, you can get the complete installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver.

    ReplyDelete
  32. Using a Canon printer service phone, you can get a full installation of the canon.com/ijsetup printer and go to the installed Canon printer to download the canon.com/ijsetup driver. To get more and more information, visit our website canon.com/ijsetup and get the information according to convenience .

    ReplyDelete
  33. Download the Canon printer from canon.com/ijsetup and set it up on your device. Canon printers are all in one printer that facilitates print, copy and scan. And to download Canon ijsetup printer drivers you can visit our website canon.com/ijsetup . Canon printers are designed for personal and business use. To learn more about Canon printers, visit our website canon.com/ijsetup and take advantage.

    ReplyDelete
  34. Canon printer is the best printer out of all printers. Which allows for the best print, copy and scan. Canon printers are designed for personal as well as commercial use. You can visit the canon.com/ijsetup website to download the Canon printer driver. To get rid of any type of problem related to Canon printers, you can contact our team at canon.com/ijsetup . For more information about Canon printers, you can visit canon.com/ijsetup and get the information as per your convenience.

    ReplyDelete
  35. You can visit the canon.com/ijsetup website to get information about Canon Multifunction Printers, Canon Printers Dealers, Retailers, Stores and Distributors. Download the driver or software for the printer scanner. To install your additional Canon driver or software, go to the canon.com/ijsetup link and follow the steps on it. To get more information about it, visit our website and enjoy.

    ReplyDelete
  36. You can use the Amazon Instant Video application on your smart TV or by installing a digital media player or video game console, which will be given by the link amazon.com/mytv in my TV description. If you need any assistance related to this, you can contact our team at amazon.com/mytv . Our entire team will be available to help you. For more information go to this link amazon.com/mytv . Amazon Instant Video Application is a very fun application.

    ReplyDelete
  37. The Amazon My TV Code program requires the customer to have an Amazon account and a streaming device or TV. Amazon Prime Video is available on almost all streaming devices like Roku, Amazon Fire TV, Chromecast. All you have to do is go to amazon.com/mytv and activate amazon.com/mytv with the help of Amazon's activation code. You can visit our website amazon.com/mytv for details of the entire process.


    To log in to your Amazon Prime Video account, enter the amazon.com/mytv on your browser and input your login information. A new screen will open asking for the "Amazon Prime Verification Code".

    ReplyDelete
  38. To setup and download the Hp priter driver software, visit our website 123.hp.com/setup . The 123 hp setup HP printer makes printing hassle-free and easy. Install the hp printer on your Windows or Mac computer and install the drivers via 123.hp.com/setup . For more information, contact our team 123.hp.com/setup . We are always available to help you.



    Be sure to install cartridges, load paper and power on the printer. Download the 123.hp.com/setup to get the recommended software for your printer. We will help you download the correct HP printer software and drivers. Which includes Windows, MacOS, iOS and Android. You can then install your 123.hp.com/setup . For installation of drives, you can take help of our website 123.hp.com/setup and enjoy.

    ReplyDelete
  39. To setup your 123 HP printer on Mac go to the 123.hp.com/setup website. For installation of drivers, you can take help of our website 123.hp.com/setup . We will help you download the correct HP printer software and drivers. you can contact our team through this website 123.hp.com/setup Can contact and get information.

    ReplyDelete
  40. A printer driver is software that your computer uses to talk to physical printers, which may be connected to your computer or another computer on your network. You can download printer drivers and software from our website 123.hp.com/setup . You can visit this 123.hp.com/setup site to install printer setup. To avoid any kind of problem you can visit our website 123.hp.com/setup and take help of our team.

    ReplyDelete
  41. To set up your HP printer, you first go to 123.hp.com/setup and follow the instructions on it. Then download the HP printer software from the 123.hp.com/setup website. HP printers are compact and durable, always ready to deal with your print needs. If you need any kind of help during setup, you can go to 123.hp.com/setup support.

    ReplyDelete
  42. You can visit the 123.hp.com/setup website to get information about 123 hp Multifunction printers, 123 hp printers Dealers, Retailers, Stores and Distributors. Download the driver or software for the printer scanner. To install your additional 123 hp driver or software, go to the 123.hp.com/setup link and follow the steps on it. To get more information about it, visit our website 123.hp.com/setup and enjoy.

    ReplyDelete
  43. Before enjoying the Hulu service you should subscribe tohttps://sites.google.com/view/site-hulucomactivate and hulu device activation code to service your Hulu account. To see all your favorite content online from https://sites.google.com/view/url-hulucomactivate enter the activation code to enter the code for hulu activation on your device. You will find this code on your registered email id. For more information, visit our website https://sites.google.com/site/hulucomactivateactivationcodes and get the information as per your convenience.

    ReplyDelete
  44. Before enjoying the Hulu service you should subscribe tohttps://sites.google.com/view/site-hulucomactivate and hulu device activation code to service your Hulu account. To see all your favorite content online from https://sites.google.com/view/url-hulucomactivate enter the activation code to enter the code for hulu activation on your device. You will find this code on your registered email id. For more information, visit our website https://sites.google.com/site/hulucomactivateactivationcodes and get the information as per your convenience.

    ReplyDelete
  45. Before enjoying the Hulu service you should subscribe to hulu.com/activate and hulu device activation code to service your Hulu account. To see all your favorite content online from hulu.com/activate enter the activation code to enter the code for hulu activation on your device. You will find this code on your registered email id. For more information, visit our website hulu.com/activate and get the information as per your convenience.

    ReplyDelete
  46. To activate your hulu activation code for tv. Enter Hulu Activation Code from hulu.com/activate and click Activate. Follow the instruction on the mentioned on the screen and complete the activation process. After complete all the steps, you will get the message ‘You are all set up’. Now you can use it for watching your favourite shows and videos.

    ReplyDelete
  47. PrimeVideo is an online store with various products and services, which you can buy on their online website primevideo.com/mytv . Prime is a membership that includes two days of distribution, music, network programs and movies. primevideo.com/mytv offers you free multi-day selections. If you want to know more about it, go to our website primevideo.com/mytv and take advantage.

    ReplyDelete
  48. The primevideo.com/mytv program requires the customer to have an Primevideo account and a streaming device or TV. Prime Video is available on almost all streaming devices like Roku, primevideo Fire TV, Chromecast. For this you just have to go to primevideo and activate primevideo with the help of primevideo activation code. You can visit our website primevideo.com/mytv for details of the entire process.

    ReplyDelete
  49. Webroot SecureAnywhere Antivirus is a powerful antivirus, designed to fight malaria and other threats. You can protect your computer, PC, and other devices from malware, viruses, spyware, etc. You can download, install and install webroot via webroot.com/safe . To install Webroot go to webroot.com/safe . If you do not have an account, go to Find My Webroot Account and create an account. If you want to know more about it, then you can visit the webroot.com/safe website.


    webroot secureanywhere gives you excellent PC security. Your antivirus software also allows downloading webroot with keycode. If you want to download and install Webroot Security on your device, go to webroot.com/safe and your Webroot Safe Download starts automatically. To know more about Webroot Antivirus, you can visit our website webroot.com/safe . You can install webroot safe by visiting our website webroot.com/safe and Our team will always be available to help you.

    ReplyDelete
  50. Webrot is quick and easy to download, install and run. In addition, the updates are automated so that you always have the current security. webroot.com/safe gives you excellent PC protection. Your antivirus software also allows downloading webroot with keycode. If you want to download and install Webroot Security on your device, go to webroot.com/safe and your Webroot safe download starts automatically. You can visit our website webroot.com/safe for details of the entire process.

    ReplyDelete
  51. You can go to webroot.com/safe website to download and install webroot. Go to webroot.com/safe with product key. And activate it. Enter webrot key code for activation. To know more about this, you can visit our given website webroot.com/safe and get information as per your convenience.

    ReplyDelete
  52. You can also go to the webroot.com/safe website to download Webroot and install it. Go to webroot.com/safe with product key. And activate it. Enter webroot key code for activation . To get more information or to know about Webroot antivirus, you can visit our given website.

    ReplyDelete
  53. Once you successfully purchase Ms. Office Equipment, you will get an office setup, in which you must enter the key. Download and install MS 365 on your PC with the help of website office.com/setup given by us. Provide the best MS Office product key for your office. To install the Office Setup Product Key, click on the link office.com/setup given by us. For more information about Office setup, visit office.com/setup and enjoy.

    ReplyDelete
  54. Select the office product you want to download and install on the device. Press on the office.com/setup option. And start downloading and installing Office products on the device. Enter the Office Setup Product Key from office.com/setup . If you do not have a new and never used product key, this product key can be used during the activation process. To get help from our team, contact the office.com/setup website.

    ReplyDelete
  55. Get your office setup from office.com/setup . If your version of Ms Office setup came with your PC, you can download or order a latest version from office.com/setup . You can also set up an office with a 25-digit activation code. For more information, you should visit our website office.com/setup . Our team is always available for your help.

    ReplyDelete
  56. To activate the office setup, you need to redeem your office 25 digit product key which you will find in your registered mail ID. Through office setup you can download, install office.com/setup . create a Ms office account to manage office.com/setup and office 2019 subscription. Contact the office.com/setup for more information.

    ReplyDelete
  57. McAfee premium security has everything you need to defend against viruses and potential cyber assaults. You can get it now from Mcafee.com/activate . All you need to do is, visit this website, log in or create a new account, redeem your activation code, and then download the installer file.
    Mcafee.com/activate | Mcafee.com/activate | Mcafee.com/activate | Mcafee.com/activate

    ReplyDelete