4.13.0.0/master: health checks smoketests by yadvr · Pull Request #3517 · apache/cloudstack

yadvr · 2019-07-24T06:41:26Z

Dummy commit for health checks

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr · 2019-07-24T06:41:43Z

@blueorangutan package

blueorangutan · 2019-07-24T06:42:12Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2019-07-24T07:02:38Z

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-177

yadvr · 2019-07-24T07:09:43Z

@blueorangutan test matrix

blueorangutan · 2019-07-24T07:10:12Z

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2019-07-24T16:44:19Z

Trillian test result (tid-213)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 32141 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t213-kvm-centos7.zip
Smoke tests completed. 77 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2019-07-24T21:57:22Z

Trillian test result (tid-214)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 50962 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t214-vmware-65u2.zip
Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_usage.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 74 look OK, 3 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_02_list_snapshots_with_removed_data_store	`Error`	1.23	test_snapshots.py
test_01_volume_usage	`Error`	12.62	test_usage.py
test_05_rvpc_multi_tiers	`Failure`	606.76	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Error`	650.83	test_vpc_redundant.py

yadvr · 2019-07-25T04:16:38Z

@blueorangutan test centos7 vmware-65u2

blueorangutan · 2019-07-25T04:17:17Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-65u2) has been kicked to run smoke tests

blueorangutan · 2019-07-25T13:33:56Z

Trillian test result (tid-218)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31481 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t218-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_list_ids_parameter.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 75 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_list_snapshots	`Error`	0.05	test_list_ids_parameter.py
test_01_scale_vm	`Failure`	16.59	test_scale_vm.py

blueorangutan · 2019-07-25T15:27:37Z

Trillian test result (tid-217)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 38147 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t217-vmware-65u2.zip
Intermittent failure detected: /marvin/tests/smoke/test_network.py
Intermittent failure detected: /marvin/tests/smoke/test_routers.py
Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_usage.py
Smoke tests completed. 73 look OK, 4 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_reboot_router	`Error`	351.35	test_network.py
test_08_start_router	`Error`	73.28	test_routers.py
test_09_reboot_router	`Error`	1.14	test_routers.py
test_02_list_snapshots_with_removed_data_store	`Error`	1.22	test_snapshots.py
test_01_volume_usage	`Error`	8.49	test_usage.py

yadvr · 2019-07-27T14:58:10Z

@blueorangutan package

blueorangutan · 2019-07-27T14:58:28Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2019-07-27T15:18:32Z

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-191

yadvr · 2019-07-27T15:20:53Z

@blueorangutan test matrix

blueorangutan · 2019-07-27T15:21:28Z

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2019-07-28T01:37:40Z

Trillian test result (tid-233)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35257 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t233-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_deploy_vm_iso.py
Intermittent failure detected: /marvin/tests/smoke/test_list_ids_parameter.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 75 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_list_snapshots	`Error`	0.04	test_list_ids_parameter.py
test_01_scale_vm	`Failure`	17.53	test_scale_vm.py

blueorangutan · 2019-07-28T05:11:41Z

Trillian test result (tid-235)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 47737 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t235-vmware-65u2.zip
Intermittent failure detected: /marvin/tests/smoke/test_routers.py
Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_usage.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 73 look OK, 4 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_08_start_router	`Error`	72.44	test_routers.py
test_09_reboot_router	`Error`	1.16	test_routers.py
test_02_list_snapshots_with_removed_data_store	`Error`	1.25	test_snapshots.py
test_01_volume_usage	`Error`	9.57	test_usage.py
test_05_rvpc_multi_tiers	`Failure`	556.89	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Error`	599.14	test_vpc_redundant.py

yadvr · 2019-07-28T05:25:45Z

@blueorangutan test

blueorangutan · 2019-07-28T05:26:31Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

blueorangutan · 2019-07-28T15:38:26Z

Trillian test result (tid-237)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34761 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t237-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 76 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_05_rvpc_multi_tiers	`Failure`	417.55	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Error`	447.06	test_vpc_redundant.py

yadvr · 2019-08-13T08:06:55Z

Last run, all pass: #3547 (comment)

yadvr · 2019-08-15T12:39:19Z

@blueorangutan

yadvr · 2019-08-15T12:39:39Z

@blueorangutan package

blueorangutan · 2019-08-15T12:39:55Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2019-08-15T13:00:39Z

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-257

yadvr · 2019-08-15T14:05:59Z

@blueorangutan test matrix

blueorangutan · 2019-08-15T14:06:56Z

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2019-08-15T23:59:03Z

Trillian test result (tid-321)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33791 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t321-vmware-65u2.zip
Smoke tests completed. 77 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2019-08-16T00:31:22Z

Trillian test result (tid-319)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35783 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t319-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 76 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_scale_vm	`Failure`	17.60	test_scale_vm.py

yadvr · 2019-08-16T11:49:39Z

@blueorangutan test

blueorangutan · 2019-08-16T11:50:00Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

yadvr · 2019-08-16T17:09:49Z

@blueorangutan test

blueorangutan · 2019-08-16T17:10:01Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

yadvr · 2019-08-20T13:35:12Z

@blueorangutan package

blueorangutan · 2019-08-20T13:36:18Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2019-08-20T13:58:00Z

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-262

yadvr · 2019-08-20T14:00:30Z

@blueorangutan test matrix

blueorangutan · 2019-08-20T14:01:18Z

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2019-08-20T19:48:44Z

Trillian test result (tid-335)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 17829 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t335-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_public_ip_range.py
Intermittent failure detected: /marvin/tests/smoke/test_reset_vm_on_reboot.py
Intermittent failure detected: /marvin/tests/smoke/test_resource_accounting.py
Intermittent failure detected: /marvin/tests/smoke/test_router_dhcphosts.py
Intermittent failure detected: /marvin/tests/smoke/test_router_dns.py
Intermittent failure detected: /marvin/tests/smoke/test_router_dnsservice.py
Intermittent failure detected: /marvin/tests/smoke/test_routers_iptables_default_policy.py
Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermittent failure detected: /marvin/tests/smoke/test_routers.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Intermittent failure detected: /marvin/tests/smoke/test_secondary_storage.py
Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
Intermittent failure detected: /marvin/tests/smoke/test_templates.py
Intermittent failure detected: /marvin/tests/smoke/test_usage.py
Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Smoke tests completed. 56 look OK, 21 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
ContextSuite context=TestResetVmOnReboot>:setup	`Error`	0.00	test_reset_vm_on_reboot.py
test_01_so_removal_resource_update	`Error`	1.58	test_resource_accounting.py
ContextSuite context=TestRouterDHCPHosts>:setup	`Error`	0.00	test_router_dhcphosts.py
ContextSuite context=TestRouterDHCPOpts>:setup	`Error`	0.00	test_router_dhcphosts.py
test_01_sys_vm_start	`Failure`	0.15	test_secondary_storage.py
ContextSuite context=TestRouterDns>:setup	`Error`	0.00	test_router_dns.py
ContextSuite context=TestRouterDnsService>:setup	`Error`	0.00	test_router_dnsservice.py
test_02_routervm_iptables_policies	`Error`	1.57	test_routers_iptables_default_policy.py
test_01_single_VPC_iptables_policies	`Error`	4.49	test_routers_iptables_default_policy.py
test_01_isolate_network_FW_PF_default_routes_egress_true	`Error`	1.59	test_routers_network_ops.py
test_02_isolate_network_FW_PF_default_routes_egress_false	`Error`	1.56	test_routers_network_ops.py
test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true	`Error`	6.56	test_routers_network_ops.py
test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false	`Error`	5.96	test_routers_network_ops.py
test_03_RVR_Network_check_router_state	`Error`	6.00	test_routers_network_ops.py
ContextSuite context=TestSnapshotRootDisk>:setup	`Error`	0.00	test_snapshots.py
ContextSuite context=TestRouterServices>:setup	`Error`	0.00	test_routers.py
ContextSuite context=TestScaleVm>:setup	`Error`	0.00	test_scale_vm.py
ContextSuite context=TestServiceOfferings>:setup	`Error`	2.57	test_service_offerings.py
test_01_list_sec_storage_vm	`Failure`	0.04	test_ssvm.py
test_02_list_cpvm_vm	`Failure`	0.04	test_ssvm.py
test_03_ssvm_internals	`Failure`	0.12	test_ssvm.py
test_04_cpvm_internals	`Failure`	0.04	test_ssvm.py
test_05_stop_ssvm	`Failure`	0.04	test_ssvm.py
test_06_stop_cpvm	`Failure`	0.04	test_ssvm.py
test_07_reboot_ssvm	`Failure`	0.04	test_ssvm.py
test_08_reboot_cpvm	`Failure`	0.04	test_ssvm.py
test_09_destroy_ssvm	`Failure`	0.04	test_ssvm.py
test_10_destroy_cpvm	`Failure`	0.04	test_ssvm.py
test_02_create_template_with_checksum_sha1	`Error`	65.58	test_templates.py
test_03_create_template_with_checksum_sha256	`Error`	65.56	test_templates.py
test_04_create_template_with_checksum_md5	`Error`	65.59	test_templates.py
test_05_create_template_with_no_checksum	`Error`	65.56	test_templates.py
ContextSuite context=TestTemplates>:setup	`Error`	3.26	test_templates.py
ContextSuite context=TestISOUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestLBRuleUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestNatRuleUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestPublicIPUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestSnapshotUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestVmUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestVolumeUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=TestVpnUsage>:setup	`Error`	0.00	test_usage.py
ContextSuite context=Test01DeployVM>:setup	`Error`	0.00	test_vm_life_cycle.py
ContextSuite context=Test02VMLifeCycle>:setup	`Error`	0.00	test_vm_life_cycle.py
test_change_service_offering_for_vm_with_snapshots	`Error`	1.59	test_vm_snapshots.py
ContextSuite context=TestVmSnapshot>:setup	`Error`	10.44	test_vm_snapshots.py
ContextSuite context=TestCreateVolume>:setup	`Error`	0.00	test_volumes.py
ContextSuite context=TestVolumes>:setup	`Error`	0.00	test_volumes.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	`Error`	9.57	test_vpc_redundant.py
test_02_redundant_VPC_default_routes	`Error`	7.48	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	`Error`	8.45	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	`Error`	7.38	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Error`	8.55	test_vpc_redundant.py
test_01_VPC_nics_after_destroy	`Error`	6.39	test_vpc_router_nics.py
test_02_VPC_default_routes	`Error`	6.26	test_vpc_router_nics.py
test_01_redundant_vpc_site2site_vpn	`Failure`	7.67	test_vpc_vpn.py
test_01_vpc_site2site_vpn_multiple_options	`Failure`	4.58	test_vpc_vpn.py
test_01_vpc_remote_access_vpn	`Failure`	4.33	test_vpc_vpn.py
test_01_vpc_site2site_vpn	`Failure`	4.49	test_vpc_vpn.py

yadvr · 2019-08-20T19:59:40Z

@blueorangutan test centos7 xenserver-71

blueorangutan · 2019-08-20T20:00:20Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

blueorangutan · 2019-08-20T23:12:10Z

Trillian test result (tid-336)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30543 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t336-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
Smoke tests completed. 77 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2019-08-21T00:46:22Z

Trillian test result (tid-337)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36106 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t337-vmware-65u2.zip
Smoke tests completed. 77 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

yadvr · 2019-08-21T07:13:22Z

@blueorangutan test centos7 xenserver-71

blueorangutan · 2019-08-21T07:14:21Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + xenserver-71) has been kicked to run smoke tests

blueorangutan · 2019-08-21T17:14:09Z

Trillian test result (tid-339)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33935 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr3517-t339-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 76 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_scale_vm	`Failure`	22.74	test_scale_vm.py

README: dummy commit

5996f6f

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

yadvr changed the title ~~master: health checks smoketests~~ 4.13.0.0/master: health checks smoketests Jul 24, 2019

yadvr added the type:healthcheckrun label Jul 24, 2019

yadvr added this to the 4.13.0.0 milestone Jul 24, 2019

yadvr mentioned this pull request Jul 25, 2019

VR smoketests failures around VR reboot and shutdown+start #3507

Closed

yadvr removed this from the 4.13.0.0 milestone Jul 25, 2019

yadvr closed this Jul 27, 2019

yadvr reopened this Jul 27, 2019

apache deleted a comment from blueorangutan Jul 29, 2019

yadvr closed this Aug 15, 2019

yadvr reopened this Aug 15, 2019

apache deleted a comment from blueorangutan Aug 21, 2019

yadvr closed this Sep 10, 2019

Conversation

yadvr commented Jul 24, 2019

Uh oh!

yadvr commented Jul 24, 2019

Uh oh!

blueorangutan commented Jul 24, 2019

Uh oh!

blueorangutan commented Jul 24, 2019

Uh oh!

yadvr commented Jul 24, 2019

Uh oh!

blueorangutan commented Jul 24, 2019

Uh oh!

blueorangutan commented Jul 24, 2019

Uh oh!

blueorangutan commented Jul 24, 2019

Uh oh!

yadvr commented Jul 25, 2019

Uh oh!

blueorangutan commented Jul 25, 2019

Uh oh!

blueorangutan commented Jul 25, 2019

Uh oh!

blueorangutan commented Jul 25, 2019

Uh oh!

yadvr commented Jul 27, 2019

Uh oh!

blueorangutan commented Jul 27, 2019

Uh oh!

blueorangutan commented Jul 27, 2019

Uh oh!

yadvr commented Jul 27, 2019

Uh oh!

blueorangutan commented Jul 27, 2019

Uh oh!

blueorangutan commented Jul 28, 2019

Uh oh!

blueorangutan commented Jul 28, 2019

Uh oh!

yadvr commented Jul 28, 2019

Uh oh!

blueorangutan commented Jul 28, 2019

Uh oh!

blueorangutan commented Jul 28, 2019

Uh oh!

yadvr commented Aug 13, 2019

Uh oh!

yadvr commented Aug 15, 2019

Uh oh!

yadvr commented Aug 15, 2019

Uh oh!

blueorangutan commented Aug 15, 2019

Uh oh!

blueorangutan commented Aug 15, 2019

Uh oh!

yadvr commented Aug 15, 2019

Uh oh!

blueorangutan commented Aug 15, 2019

Uh oh!

blueorangutan commented Aug 15, 2019

Uh oh!

blueorangutan commented Aug 16, 2019

Uh oh!

yadvr commented Aug 16, 2019

Uh oh!

blueorangutan commented Aug 16, 2019

Uh oh!

yadvr commented Aug 16, 2019

Uh oh!

blueorangutan commented Aug 16, 2019

Uh oh!

yadvr commented Aug 20, 2019

Uh oh!

blueorangutan commented Aug 20, 2019

Uh oh!

blueorangutan commented Aug 20, 2019

Uh oh!

yadvr commented Aug 20, 2019

Uh oh!

blueorangutan commented Aug 20, 2019