*Neutron vs. the Gate *Current Limitations of Neutron tests These are the ways in which Neutron is tested massively less than the rest of OpenStack * Doesn't support tenant isolation * Can't run the full tempest test suite * Can't run tests in parallel * Is not included in any way in upgrade testing (grenade) * Largely doesn't have API testing in tempest * Only a single scenario test in tempest does any real testing * Only runs one tempest job - fixed during Havana RC phase Keeping ourselves honest, helping us bootstrap * Standing agenda item on every neutron / tempest meeting until solved * Identify Tempest czar in neutron != markmcclain * Post meeting IRC session to dive in - schedule in IRC * Bootstrapping session sdague & markmcclain to coordinate * looking for volunteer help on knowledge transfer * *Tenant Isolation & Parallel Testing Issue: neutron can't run parallel testing. in all cases where we've tried to turn tenant isolation and parallel testing on in the gate neutron breaks due to internal race conditions. Parallel testing only provides 4 simultaneous clients, so this is a very small load that things fail on. (We actually haven't really tried parallel with neutron yet because we need tenant isolation first) Solution: * Fixing agent framework in neutron, can't handle load generated by tempest. - mark mcclain * L3 agent, DHCP agent, LBaaS (services that use scheduler) * Request id tracking through all the services. - maru * https://review.openstack.org/#/c/52128/ amotoki * Correct logging for failure detection. - dkehn Milestone: Who owns this: Maru, Mark McClain, Salvatore, Bob ? Notes: *Full Tempest Test Runs Issue: Neutron doesn't run fully tempest runs because it provides incompatible nova/network interface Solution: Milestone: Who owns this: Brent Eagles Notes: *Grenade Support Issue: Neutron isn't included in grenade at all Solution: Milestone: Who owns this: Notes: *API Tests Issue: Lacking a number of tests. Great place for new people to dive in. Current API tests really don't check the API operation has been executed all the way down the stack Solution: Increase coverage; provide support for negative tests; verify operation on backend Milestone: Incremental - Core + L3 -> Icehouse-1 - Security groups + Other L2/L3 extensions -> Icehouse-2 - L4/L7 services (FW, LB, VPN) -> Icehouse-3 Who owns this: Salvatore (since he's supposed to look after the Neutron API) Notes: *Scenario Tests Issue: Solution: Milestone: Who owns this: Notes: