ETSI TC MTS Contribution to Testing in IoT and Edge Computing
0 likes76 views
The document discusses testing in IoT and edge computing. It motivates the need for standardized testing approaches given the high quality and confidence required for IoT and edge communication protocols and configurations. It envisions computing standards being accompanied by defined test scenarios and catalogs using standardized specification techniques. Existing testing approaches from domains like mobile networks can be applied, and work has been completed on test specifications for protocols like CoAP and MQTT. However, distributed and heterogeneous edge architectures present specific challenges for testing distributed systems, edge node management, and performance under resource restrictions at the IoT layer.
More Related Content
Similar to ETSI TC MTS Contribution to Testing in IoT and Edge Computing (20)
More from Axel Rennoch (7)
Recently uploaded (20)
ETSI TC MTS Contribution to Testing in IoT and Edge Computing
- 1. ETSI TC MTS Contribution to Testing in IoT and Edge Computing Axel Rennoch, Sascha Hackel Fraunhofer FOKUS, Berlin AIOTI Edge Computing Standard Framework Concepts Release 1.0 • 27th October 2021
- 2. 2 ETSI TC MTS Motivation • IoT and Edge computing communication protocol and configuration requires especially high quality and confidence in the implementations. • This applies for any test activities/scenarios, including functional conformance, interoperability scenarios or non-functional testing types (like robustness/security or performance). • Testing methods and techniques should follow standardized approaches (as e.g. for mobile communication).
- 3. 3 ETSI TC MTS Vision • Computing technologies and standards should be accompanied by corresponding unique definitions of test scenarios and catalogues (using standardized and well-known specification techniques). • Certification will be based on standardized test catalogues and implementations using e.g. ETSI test languages (TDL and TTCN-3). • Samples are provided in AIOTI Report, Section 4.2.4
- 4. What do we have? In AIOTI Edge Computing Standard Framework Concepts Release 1.0
- 5. 5 Use of Existing QA/Testing Approaches ➢ Standardized Test purposes • Used in multiple domains: e.g. mobile, access/core networks, ITS, IoT • Test types, e.g. conformance, interop, security ➢ Advanced testing technology: • Used for certification: e.g. UMTS, LTE, 5G, oneM2M ➢ Qualified IoT-Testware (code): • Executable with open source or commercial TTCN-3 tools
- 6. 6 Working Results (see AIOTI report) ETSI committee on Methods for Testing and Specifications completed a first set of test specification standards: • CoAP conformance, security and performance (TS 103 596) • MQTT conformance, security and performance (TS 103 597) • Foundational Security IoT-Profile by IEC 62443 (TS 103 646) Available from ETSI: MTS Test specifications for IoT: www.etsi.org/standards/getstandards#page=1&TB=860&sort=3
- 7. What we do have to consider? For AIOTI Edge Computing Standard Framework Concepts Release 1.x
- 8. 8 Specific IoT and Edge Aspects for Testing Distributed, heterogeneous architectures and interfaces • Interoperability and Security requirements • Multiple vendor devices/platforms • Domains specific applications, objects and functions (under test), use cases • Synergies and reusability of test harness from different verticals? Management at the edge (nodes) • Mobility of devices • Elasticity and fluctuation of data workload (container/kubernetes pods etc.) • Provisioning, orchestration and coordination (deterministic capabilities, SDN) Performance/resource restrictions at IoT layer • Big amount of devices (capacity and scalability) • Ultra-low latency (≈ ms) is critical for real-time type of application • Limited connectivity and power consumption (limited autonomy)
- 9. 9 Challenges for IoT and Edge Testing Distributed, heterogeneous architectures and interfaces: Scope / Testing types for EC • Conformance and Security (before commissioning safety-critical systems) • The human element must be considered in all aspects of safety • Interoperability • Performance, real-time aspects Management at the edge (nodes): Systematic Test definition/specification • Test suite structuring: Test configurations; IUT roles (server/client) • Test objectives (test purpose catalogs) • Use case scenarios (test case implementation) Performance/resource restrictions at IoT layer: Testbed and software architecture (tools) • Demonstrate readiness of domain-specific solutions • Certification
- 10. 10 Summary • Testing/QA is important • Very good standardized methods and techniques • Standardization is key for certification • More specific challenges for IoT and Edge computing (input to gap analysis)
- 11. 11 Thank you for listening. Any questions? You can find us at www.fokus.fraunhofer.de/en/sqc or email axel.rennoch@fokus.fraunhofer.de or sascha.hackel@fokus.fraunhofer.de