testing-the-unanticipated:-how-instrumental-brings-ai-to-quality-inspection

There is a lot of talk of applying artificial intelligence and machine learning to manufacturing. But the big question is still: How can AI actually lead to better manufacturing outcomes? For Palo Alto, CA-based Instrumental the best opportunity lies in using AI for quality assurance and testing.

Anna-Katrina Shedletsky (Image source: Instrumental)

By aggregating images from cameras placed throughout the manufacturing line, Instrumental uses a combination of cloud- and edge-based machine learning algorithms to detect product defects and failures throughout the manufacturing process. The company’s system has already found use cases with name brands including FLIR, Motorola, and Pearl Auto.

Design News spoke with company Founder and CEO, Anna-Katrina Shedletsky, about Instrumental’s machine learning technology, how her time as an engineer at Apple sparked her vision for the company, and the company’s larger vision to transform supply chains forever using AI.

Design News: You spent time at Apple working on the Apple Watch? How do you transition from working at Apple to where you are now having founded Instrumental?

Anna-Katrina Shedletsky: My background is as a mechanical engineer. I was at Apple for six years. I led a couple of product programs there and then I was tapped to lead with some product design for the very first Apple Watch.

The role was very interesting because I was responsible for the engineering team that we flew to China. We stood on the [assembly] line and we’d try to find issues. I had visibility into all that minutia, and I was really seeing how the tail can wag the dog in terms of these seemingly small defects on the line having major impacts.

DN: Was this something that was unique to Apple?

Shedletsky: No, all the companies in the space have this problem. Something like a machine stretching your battery too much can cause your Samsung Galaxy Note 7 problem. You can create these inadvertent perfect storms where these quite small things can impact when you ship the product the schedule, how much money the company is going to make on it, how many returns there are – all of that stuff.

In my role I was continually frustrated by not having good tools to actually fix those small and minute problems – some of which are actually very big from a business perspective. So I decided to leave Apple and start a company to build that technology.

DN: Can you walk us through Instrumental’s machine learning technology and how it works?

Shedletsky: The whole thing we’re trying to do is to actually find defects that our customers have not yet anticipated.

If you know that there’s a certain type of failure mode that could happen as an engineer you can try to design it out or minimize it. You can also put tests in place. What Instrumental does is we’re very focused on finding these unanticipated defects.

Our neural networks learn from a very small sample of units – about 30 pieces is enough to get started. The algorithms learn what is normal based on just normal input – we don’t need perfect units or defect samples – and from there we can set up tests to essentially identify new defects that weren’t anticipated. We can also still look for defects that you do anticipate. So if you do find the defect you can set up an ongoing test to make sure you can catch those units in the future.

Instrumental uses machine learning algorithms to determine what  product details are important or not and flag potentially serious issues for engineers.

DN: In your sampling of about 30 images or so are you basically telling the algorithm, “this is what the ideal product should look like” from various angles and it’s looking for any deviations from that?

Shedletsky: Actually it’s even better than that. If you have to produce an ideal unit that’s really hard to do in real life. What Instrumental is trying to do is actually determine which differences matter and which differences don’t matter and highlight the ones that matter.

As an engineer I’m very creative; I can come up with a thousand different ways that something can go wrong and fail. But I can’t create a thousand different tests. It’s not practical.

The beauty of machine learning is that we learn over time from the data set about what differences matter. An example of a difference that doesn’t matter might be the orientation of the screw head. So our algorithms become desensitized to that particular area.

However, if we’ve seen 20,000 images that all look pretty much the same and then suddenly there’s an image where something is different. There’s a really high probability that that difference is important.

From an engineering perspective we’re building hundreds, thousands, or in some cases even millions of units a day. I can’t look at all of these images, but if a computer can show me the top one percent that are interesting I will look at those because I’m trying to see if there are true defects. Then I can set up enduring tests that make sure that we can find those defects in the future.

DN: Is there any sort of limit to how many tests or experiments an engineer could have running on a particular product?

Shedletsky: We haven’t found it yet. In terms of running live on the line, tests do add some time, but we’re talking about milliseconds. Today if you want to add an inspection test for a human any kind of test is going to add a second or two. Human inspectors can typically only inspect about five things total per person. So if you wanted to test five different ways something could fail that would take up your whole human, and that human will probably take 10 seconds to do that inspection. We can do those five tests much faster and in real time.

Now, if you ran, say, a thousand tests I think it would it would slow us down initially, but we would work hard to bring that the back up. Our customers are typically running 10 to 15 tests on an individual kind of inspection – an inspection being a whole view of the product.

Design News: There’s also a physical component necessary as well, right? Can you talk a bit more about the hardware setup required for this?

Shedletsky: We create images from an array cameras that are deployed wherever the manufacturing lines are. The reason is because you want checkpoints that keep states of assembly before you close up the unit and it’s hard to get back at it.

We put our vision in places where vision hasn’t typically been deployed in the past. Typically industrial vision is deployed for a very, very narrow purpose like, “I want to measure this gap.” We’re using it in different way that’s more generalized.

DN: Are these proprietary cameras? How does the camera system get implemented?

Shedletsky: The cameras are not proprietary. They’re off-the-shelf. We can integrate if customers already have cameras that are producing images. Many of our customers do have cameras that are in reasonable spots where they want the data records; they just want this augmentation for new defects as well.

DN: How big of an infrastructure change is it for companies that don’t already have large integrated camera systems? What’s the implementation process like?

Shedletsky: The reason we built our own hardware stations is so that we can deploy them incredibly quickly. We do not rely on our customers to have significant infrastructure in place. We sit down with our customers, we figure out where we’re going to put stations on the line, and then four weeks later we show up with equipment. We literally plug it into the wall and then we’re ready to go.

We’re not taking [assembly] lines down to do this. We get everything set up. It takes about an hour or two per station. We calibrate, we train everybody, and then they just run their build and we’re just like a station on their line.

74 comments

  1. I’m really loving the theme/design of your blog. Do you ever run into any browser compatibility issues?
    A few of my blog visitors have complained about my website not working correctly in Explorer but looks great in Firefox.

    Do you have any solutions to help fix this problem?

  2. Thank you, I’ve recently been searching for info
    approximately this topic for ages and yours is the best I have discovered till now.
    However, what in regards to the conclusion? Are you positive concerning the
    supply?

  3. Greetings, I think your site might be having internet
    browser compatibility issues. Whenever I look at your website in Safari, it looks fine but when opening in Internet Explorer, it’s got some overlapping issues.
    I just wanted to give you a quick heads up! Aside from
    that, excellent blog!

  4. Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point.

    You clearly know what youre talking about, why
    throw away your intelligence on just posting videos to your site when you could be giving us something informative
    to read?

  5. If some one wishes to be updated with most recent technologies afterward he
    must be visit this web page and be up to date all
    the time.

  6. Wow that was odd. I just wrote an very long comment but after I clicked submit my comment
    didn’t show up. Grrrr… well I’m not writing all that
    over again. Anyhow, just wanted to say great blog!

  7. Its like you read my thoughts! You appear to grasp so much about this, like you wrote the ebook in it or something.
    I believe that you simply could do with a few p.c.
    to power the message house a little bit, however instead of
    that, that is magnificent blog. A fantastic read. I’ll certainly
    be back.

  8. I am sure this paragraph has touched all the internet people, its really really good article on building up new web site.

  9. We are a bunch of volunteers and starting a new scheme in our community.

    Your website provided us with valuable information to work on. You have done
    a formidable process and our whole group will probably be grateful to you.

  10. It’s very trouble-free to find out any matter on net as compared to textbooks,
    as I found this article at this site.

  11. My family members always say that I am wasting my time here at web,
    except I know I am getting experience daily by reading thes
    fastidious articles or reviews.

  12. I think that everything typed was very logical. But, think on this, what if
    you wrote a catchier post title? I mean, I don’t
    wish to tell you how to run your blog, however what if
    you added a headline that makes people desire more? I mean Testing the Unanticipated:
    How Instrumental Brings AI to Quality Inspection – Pavvy Designs is
    a little vanilla. You might glance at Yahoo’s home page and note how
    they create post headlines to grab viewers to open the links.

    You might add a related video or a pic or two to get readers excited about what you’ve got to say.

    In my opinion, it would make your website a little livelier.

  13. I am regular visitor, how are you everybody?
    This piece of writing posted at this website is really pleasant.

  14. Hey there just wanted to give you a quick heads up.
    The words in your article seem to be running off the screen in Firefox.
    I’m not sure if this is a formatting issue or something to do with internet browser compatibility but I thought I’d post
    to let you know. The design and style look great
    though! Hope you get the issue solved soon. Many thanks

  15. Thanks for the marvelous posting! I seriously enjoyed reading it, you
    are a great author.I will make certain to bookmark your blog and will
    eventually come back in the foreseeable future.

    I want to encourage you to ultimately continue your great posts, have a nice afternoon!

  16. Fascinating blog! Is your theme custom made or did you download it from somewhere?
    A design like yours with a few simple tweeks would really
    make my blog stand out. Please let me know where you got your design. Bless you

  17. Generally I don’t learn post on blogs, but I would
    like to say that this write-up very forced me to try and
    do so! Your writing style has been amazed me. Thanks, very nice post.

  18. I feel this is among the so much vital information for me.
    And i am satisfied studying your article. However want to observation on some basic issues, The site
    style is perfect, the articles is in point of
    fact great : D. Just right task, cheers

  19. I’d like to thank you for the efforts you have put in writing this
    website. I am hoping to see the same high-grade content from you in the
    future as well. In fact, your creative writing abilities has inspired me to get my own website
    now 😉

  20. Write more, thats all I have to say. Literally, it seems as though
    you relied on the video to make your point. You clearly know what youre talking about, why
    throw away your intelligence on just posting videos to your blog when you could be giving us something enlightening
    to read?

  21. This piece of writing offers clear idea in support of
    the new people of blogging, that actually how
    to do running a blog.

  22. Its like you read my mind! You seem to know a lot about this, like you wrote the book in it or something.
    I think that you can do with a few pics to drive the message home a bit,
    but instead of that, this is magnificent blog. An excellent read.

    I will definitely be back.

  23. Woah! I’m really digging the template/theme of this site. It’s simple, yet
    effective. A lot of times it’s tough to get that “perfect balance” between user friendliness
    and visual appearance. I must say you have done a very good job with this.
    Also, the blog loads very fast for me on Opera. Outstanding Blog!

  24. Heya i’m for the first time here. I came across this board and I find It truly useful &
    it helped me out a lot. I hope to give something back and aid
    others like you helped me.

  25. Quality posts is the secret to invite the visitors to visit the web site, that’s what this site is providing.

  26. Greetings from Idaho! I’m bored to death at work so I decided to check out your site on my iphone during lunch break.
    I enjoy the knowledge you present here and can’t wait to take
    a look when I get home. I’m shocked at how fast your
    blog loaded on my phone .. I’m not even using WIFI, just 3G ..
    Anyhow, awesome blog!

  27. I don’t even understand how I stopped up here, but I thought this put up
    was once good. I do not recognize who you might be
    however certainly you’re going to a well-known blogger in the event you aren’t already.
    Cheers!

  28. Pretty section of content. I just stumbled upon your web site
    and in accession capital to assert that I acquire in fact enjoyed account your blog posts.
    Any way I will be subscribing to your feeds and even I achievement
    you access consistently quickly.

  29. Hello friends, how is everything, and what you would like to say on the topic of
    this piece of writing, in my view its genuinely awesome designed for me.

  30. That is really interesting, You are an excessively professional blogger.

    I’ve joined your rss feed and look forward to in search of extra of your excellent post.
    Also, I have shared your web site in my social networks

  31. Thanks a lot for sharing this with all of us you actually
    recognize what you’re speaking approximately! Bookmarked.

    Kindly also seek advice from my web site =).
    We may have a link change arrangement among us

  32. When someone writes an piece of writing he/she keeps the thought of a user in his/her brain that how
    a user can know it. Therefore that’s why this piece of writing is outstdanding.
    Thanks!

  33. When I originally commented I clicked the “Notify me when new comments are added” checkbox and now
    each time a comment is added I get three emails with the same comment.
    Is there any way you can remove people from
    that service? Bless you!

  34. Hello there, just became aware of your blog through Google,
    and found that it’s really informative. I’m gonna watch out for
    brussels. I will appreciate if you continue this {in future}.

    Many people will be benefited from your writing. Cheers!

  35. This design is steller! You obviously know how to keep a reader entertained.
    Between your wit and your videos, I was almost moved to start
    my own blog (well, almost…HaHa!) Wonderful job. I really
    loved what you had to say, and more than that,
    how you presented it. Too cool!

  36. You could certainly see your skills within the work you write.
    The sector hopes for more passionate writers like you who
    are not afraid to say how they believe. All the time go after
    your heart.

  37. If you desire to improve your experience simply keep visiting this
    web page and be updated with the most up-to-date news posted here.

  38. Pretty nice post. I just stumbled upon your blog and wanted to mention that I have really enjoyed browsing
    your blog posts. After all I will be subscribing in your
    feed and I’m hoping you write once more very soon!

  39. Unquestionably believe that which you stated. Your favourite
    justification seemed to be at the internet the easiest thing to take into accout of.
    I say to you, I definitely get irked even as people think about concerns that they just do not understand about.

    You controlled to hit the nail upon the top and also defined out the
    entire thing without having side-effects , other people
    can take a signal. Will probably be again to get
    more. Thanks

  40. I’m not sure exactly why but this web site is loading extremely slow for me.
    Is anyone else having this issue or is it a problem on my end?
    I’ll check back later and see if the problem still exists.

  41. whoah this blog is wonderful i really like studying your posts.
    Keep up the good work! You realize, a lot
    of individuals are looking around for this information, you could aid them greatly.

  42. Heya i am for the first time here. I found this board
    and I find It really useful & it helped me out a lot.
    I hope to give something back and help others like you helped me.

  43. Hi there! This is my first visit to your blog! We are a group of volunteers and
    starting a new project in a community in the same niche.
    Your blog provided us useful information to work on. You have done a marvellous job!

  44. I am really enjoying the theme/design of your blog.
    Do you ever run into any browser compatibility problems?

    A few of my blog visitors have complained about my blog not operating correctly in Explorer but looks great in Opera.
    Do you have any ideas to help fix this problem?

  45. Thank you, I have just been searching for information approximately this subject for ages and yours is
    the greatest I have found out so far. However, what
    concerning the conclusion? Are you positive about the source?

  46. Oh my goodness! Awesome article dude! Thanks,
    However I am having difficulties with your RSS.
    I don’t know the reason why I am unable to subscribe to it.
    Is there anybody else getting the same RSS problems?
    Anybody who knows the solution will you kindly respond?
    Thanks!!

  47. I seriously love your site.. Very nice colors & theme. Did you
    develop this web site yourself? Please reply
    back as I’m looking to create my very own blog and
    would love to know where you got this from or what the theme is called.
    Kudos!

  48. Hey there just wanted to give you a quick heads up. The text in your article seem to be
    running off the screen in Firefox. I’m not sure if this is a formatting
    issue or something to do with web browser compatibility but I figured I’d post to let you know.
    The design look great though! Hope you get
    the problem fixed soon. Kudos

  49. Thanks for ones marvelous posting! I actually
    enjoyed reading it, you are a great author.I will be sure to bookmark your blog and will eventually come
    back down the road. I want to encourage you continue your great job,
    have a nice weekend!

  50. I do not know whether it’s just me or if everyone else encountering issues with your site.

    It seems like some of the text on your content are running off the
    screen. Can somebody else please provide feedback and let me know if this is happening to them too?
    This might be a issue with my web browser because I’ve had this
    happen previously. Many thanks

    Review my web-site; poker pulsa online

  51. I’ve read a few good stuff here. Definitely worth bookmarking for revisiting.
    I surprise how much effort you place to make this sort of excellent informative web
    site.

  52. I’m not sure exactly why but this website is loading extremely
    slow for me. Is anyone else having this issue or is it a
    issue on my end? I’ll check back later and see if the problem still exists.

  53. I read this article completely regarding the resemblance of most up-to-date and preceding technologies, it’s awesome article.

  54. Hello, i think that i saw you visited my weblog thus i came to “return the favor”.I’m trying to find things to improve my site!I suppose its ok to use
    some of your ideas!!

  55. Hmm is anyone else having problems with the images
    on this blog loading? I’m trying to determine if its a
    problem on my end or if it’s the blog. Any responses would be greatly appreciated.

  56. Hello there! I could have sworn I’ve visited this website
    before but after browsing through a few of the arfticles I realized it’s new to me.
    Nonetheless, I’m certainly happy I came across it and I’ll be bookmarking it and checking back regularly!

    My homepage :: Cam4

Leave a Reply

Your email address will not be published.