• Twitter
  • LinkedIn
  • Xing
+49 7353 981781
Heicon Ulm
  • HOME
  • COMPANY
  • PRODUCTS
  • HEICON BLOG
  • English
    • Deutsch
    • English
  • Menu Menu
You are here: Home1 / B_Validation and Verification

Testing AI systems – possible or impossible?

B_Validation and Verification

What feelings does the term artificial intelligence (AI) evoke in you? For some, a future without the use of artificially intelligent systems is no longer imaginable. In this world, artificial intelligence helps autonomous driving to make a breakthrough, reliably makes medical diagnoses and autonomous robots care for our elderly.

For many other people, these are precisely the worst imaginings of the future. They fear that artificial intelligence will make us humans superfluous, causing millions of unemployed and gaining power over us.

The following article addresses artificial intelligence from a neutral point of view. Artificial intelligence is not good or evil, but simply a technology that can be used to solve certain problems.

First, we consider the definition of AI and current fields of AI applications. After that, we discuss challenges and possible solutions when testing artificial intelligence systems. Read more

14. May 2021/0 Comments/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2021-05-14 21:52:282021-09-29 12:31:10Testing AI systems – possible or impossible?

Static analysis and dynamic testing: What are the strengths and weaknesses?

B_Validation and Verification

Static analysis and dynamic testing: Even after several decades of software engineering, we still far away from guaranteed error-free software. Even for software developed to the highest safety standards, no one can guarantee absolute freedom from errors. All functional safety standards recognize that a guaranteed error-free software (with the current state of the technology) cannot be achieved. The measures in the standards have the goal to minimize the number of errors and to detect occurring errors in time to prevent a serious error effect.

The static analysis and dynamic testing represent two such measures. Especially in safety-relevant systems, the use of both measures is required, although in some cases the same errors are found.

Extensive validation, verification and testing is associated with high costs. In most projects this leads to a high pressure to develop an optimized test strategy.

A prerequisite for successful test optimization strategies is the comprehensive understanding of strengths and weaknesses of static analysis and dynamic test and analyses. The following article provides a basic overview of the topic.

Read more

4. August 2020/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2020-08-04 19:01:292021-02-03 21:23:05Static analysis and dynamic testing: What are the strengths and weaknesses?

Risk-based testing: Method for identifying the right test cases

B_Validation and Verification

There is no such thing as bug-free software! Nevertheless, software is successfully used even in very critical systems. The software development processes have become so mature that it is possible to reduce the number of errors in the software reliably to such an extent that the number of system errors which have their cause in the software have become so small that they are accepted by society. In these safety relevant projects mainly specification-based, efficiency-based and structure-based test design methods are used. Risk-based testing has not played a significant role in this area so far. On the other hand, the complexity and scope of software is also increasing strongly in the safety-relevant area. Trends such as Industry 4.0 and autonomous driving strongly support this development. Under what conditions could risk-based testing take on a more important role in the safety-relevant area in the future? How can this test design technique be improved so that the technique itself can be further disseminated? The following blog post discusses the strengths and weaknesses of risk-based testing and suggests ways to improve the technique itself. An overview of common test design methods can be found in the blogpost Comparison and evaluation of different test design techniques.

Read more

23. March 2020/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2020-03-23 17:36:092021-02-03 21:23:35Risk-based testing: Method for identifying the right test cases

Comparison and evaluation of different test design techniques.

B_Validation and Verification

The complexity of technical systems has been increasing for years and there is no foreseeable end to this. The crucial driver of innovation is software. Very powerful hardware in combination with complex software are the basis for trends such as IOT, autonomous driving, Smart Home and human-robot collaboration, to list just a few.

Today, software enables the realization of functionalities with a complexity that was never imaginable with electronics or mechanics alone.

However, this also increases the potential errors in a system. There is no such thing as guaranteed error-free software! A major reason for this is that it is not possible to test an industry relevant software system completely. This is due to the fact that the number of data and control flow paths that can be passed through a software system tends to be infinite. With this background, the following article introduces common test design techniques and evaluates their strengths and weaknesses.

Read more

15. February 2020/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/06/DI1A5942_klein.png 365 547 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2020-02-15 17:18:342021-02-03 21:24:11Comparison and evaluation of different test design techniques.

Implicit Testing – A good idea (Part 2)?

B_Validation and Verification

In the first part of the blog I defined the term Implicit Testing and discussed root causes for the need of implicit tests. Now, in the second part I will focus on the disadvantages of such tests and on possible solution approaches with the goal to avoid these disadvantages. Read more

31. March 2017/0 Comments/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2017-03-31 22:19:052021-02-03 21:24:36Implicit Testing – A good idea (Part 2)?

Implicit Testing – A good idea (Part 1)?

B_Validation and Verification

In larger safety-critical projects, quite often I hear the following statement: “Well, the Requirement A is indirectly or implicitly proven with the test XY!” Do you know this sentence as well? Have you ever experienced what can happen in late project phases when you have tested many requirements indirectly?
The blog defines the term in part 1 and it discusses the causes of implicit testing.
Read more

21. February 2017/0 Comments/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2017-02-21 22:50:232021-02-03 21:25:04Implicit Testing – A good idea (Part 1)?

Structural source code coverage and Requirements – Is there any dependency?

B_Validation and Verification

If you are newly engaged in the area of functional safety, then you will encounter fairly quickly the terms “structural source code coverage” and “requirements”. The specification of technical systems by requirements is, of course, also common in non-safety-critical areas. By contrast, the subject structural source code coverage is almost unknown outside safety-critical projects.
In this blog I want to discuss these two methods and the underlying processes. In particular, the question of inter-dependence is exciting. Read more

27. July 2016/0 Comments/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2016-07-27 13:30:412021-02-03 21:25:44Structural source code coverage and Requirements – Is there any dependency?

Psychology of Testers

B_Validation and Verification

What is the Psychology of Testers? What qualities characterize good people working in the testing area? Well, you can define some criteria: expertise- and methods know-how are sure essential characteristics. In addition, they must have management skills and bring social skills. These are certainly necessary skills. However, it is missing an important point that I want to explain further in this blog: Who wants to be a master in the test area, must also be constructive and destructive!

Read more

28. November 2015/1 Comment/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2015-11-28 16:47:212021-02-03 21:26:26Psychology of Testers

Testing of platforms: A challenge!

B_Validation and Verification

Testing of platforms are challenges! Do you develop platforms in embedded systems in order to offer more customer solutions without having to make a completely new development for each customer project?
Or do you have used an embedded operating system in order to develop your application as independent as possible from the hardware?
For the development of the systems you have probably benefited from this policy, but what was about the testing? Was it clear and easy to test the platform? Was it easy to achieve complete test coverage? Were you able to quickly and efficiently create good requirements? No? Then you are right here!

Read more

25. October 2015/0 Comments/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2015-10-25 21:21:292021-02-03 21:26:55Testing of platforms: A challenge!

Management aspects of testing

B_Validation and Verification

Management aspects of testing : Often Testing is a hassle topic. Time is short. The number of unmanageable tests, review and analysis is high. Employees are not really motivating for the subject. The technical resources are not sufficient. In the opinion of management, the expected result is already predetermined: no mistakes! Do you know this situation or something similar? As a test manager in such a project it is not easy to handle these situations. This blog discusses Management Aspects of Validation and Verification?
Read more

24. October 2015/0 Comments/by HEICON Global Engineering GmbH
https://heicon-ulm.de/wp-content/uploads/2020/08/DI1A5942_klein_VV_Eng.jpg 431 553 HEICON Global Engineering GmbH https://heicon-ulm.de/wp-content/uploads/2020/07/heicon-logo-5.png HEICON Global Engineering GmbH2015-10-24 21:40:592021-02-03 21:27:26Management aspects of testing

Categories

  • A_Requirement Engineering
  • B_Validation and Verification
  • C_Config- / Change Management
  • D_Security
  • FuSa__General
  • FuSa_Aerospace
  • FuSa_Agriculture
  • FuSa_Automotive
  • FuSa_Industrial
  • FuSa_Railway

Contact

HEICON Global Engineering GmbH
Dipl. Ing. (FH) Martin Heininger
Kreuzweg 22
88477 Schwendi

Phone: +49 7353 – 98 17 81
Mobile: +49 176 – 24 73 99 60

Email: info[at]heicon-ulm.de

IMPRINT  |  DATA PROTECTION

Scroll to top