LI

Smart regression testing system

Nokia will review all Submissions to this challenge and invest in piloting a winning solution in Nokia R&D. And based on the fee
Owning Partner
Starts
Ends

Details

In a telco R&D, we are working with a very big existing system, including many legacy functionalities. After knowing the capability of a machine leanring (ML) based AI system, we expect that it can be applied to improve our regression testing.

Now when we have a new requirement, we typically do the implementation on top of the existing system. So, from testing point of view, we will do new functional testing with the following procedure:

  1. A new requirement defines a new solution;
  2. To test the solution, we define new test cases;
  3. We execute the test case to say if the solution is OK or not to meet the requirement.

And on the other hand, we spend huge effort and HW resources to do regression testing – verifying that the new change doesn't break any existing functionalities. But only a few of them will catch bugs.

With test automation, we have already categorized the regression case sets in layers and with different tags, and tests from the most basic ones to the most advanced features. However, the feedback about case quality, the analysis of testing result, the selection of regression case set and the scheduling algorithm for different case sets are still manual, and highly depending on the skill level of our testing experts.

We have already had a set of test cases, and know their corresponding code coverage; a history test record about the regression case set and its execution results (execution time, logs, pass/no pass); a list of bug reporting data.

By feeding these data to the SMART regression testing system, we expect that when there is a new code commit, the system can output a set of regression cases with execution order automatically.

Assets

There are no assets in this challenge.

Attachments

There are no attachments in this challenge.

Who can create a challenge?

  • If you want to publish a challenge on the NokiaPartners - Open communities and get support from the community to solve your problems, you first need to be registered on the platform. Then you need to contact the NokiaPartners - Open communities administrator in the Community section. They will create the challenge for you. Search for “admin” in the Community section, and click on “Nokia Admin” to contact and ask for your challenge to be created.

 

How do I submit an answer/proposal?

  • To contribute to a challenge, first open the challenge page, and then click on the "start proposal" button on the right-hand-side. A new page will appear with different text fields to fill in and attachments to include. You can also link to an existing project you have previously created on the platform. Once you have finished, click on submit.
  • If you save as draft, your submission will not be completed and will not be submitted to the challenge owner.

 

What happens once I submit?

  • Once you have submitted your proposal, your ‘Challenge Submission Form’ becomes accessible by the creator or the challenge, who can see and edit your proposal. Through the challenge page, only the owner of the challenge can see the different proposals submitted against his/her challenge. It is up to the challenge owner to inform participants about decisions and potential next steps.
  • To note, when you save a submission as draft, it is not submitted to the challenge owner.

 

Who can see my proposal?

  • The owner of the challenge, the submission review committee, and the NokiaPartners - Open communities Administrator team are the only ones who can see your proposed ideas and solutions to the challenge.

 

What happens if my proposal is successful?

  • For each challenge, submission review and selection process is different and the responsibility of the challenge owner. If your project is selected, the owner of the challenge will come back to you with further guidance on the next steps.

 

What happens if it is unsuccessful?

  • For each challenge, submission review and selection process is different and the responsibility of the challenge owner. If your project is not shortlisted, the owner of the challenge will inform you using the messaging features of NokiaPartners - Open communities. Your proposed ideas will then be removed/deleted from challenge submissions.