Add and update CDW modules (#29)

* Add 'dw_database_catalog' and 'dw_database_catalog_info' modules
* Add 'dw_virtual_warehouse' and 'dw_virtual_warehouse_info' modules
* Update 'dw_cluster' and 'dw_cluster_info' modules documentation
* Normalize top-level key for return values from 'clusters' to 'cluster' for 'dw_cluster'
* Add 'private_load_balancer' option to 'dw_cluster' module
* Replace 'cdpy.dw.gather_clusters()' call with 'cdpy.dw.list_clusters()' call in 'dw_cluster_info' module to reduce scope of returned values (will require explicit 'dw_*_info' calls to achieve prior returned values)
* Add 'violations' as discrete key within returned SDK errors
* Add check for verbosity or debug to SDK warnings handler
* Update parameter naming, aliases, and requirements across all 'dw_*' modules

Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
Signed-off-by: Webster Mudge <wmudge@cloudera.com>
Co-authored-by: Saravanan Raju <saravanan.footloose@gmail.com>

Author: wmudge

docsrc/index.rst

@@ -19,6 +19,10 @@ cloudera.cloud Ansible Collection
    df_info <df_info>
    dw_cluster <dw_cluster>
    dw_cluster_info <dw_cluster_info>
+   dw_database_catalog <dw_database_catalog>
+   dw_database_catalog_info <dw_database_catalog_info>
+   dw_virtual_warehouse <dw_virtual_warehouse>
+   dw_virtual_warehouse_info <dw_virtual_warehouse_info>
    env <env>
    env_auth <env_auth>
    env_auth_info <env_auth_info>

plugins/README.md

@@ -20,6 +20,10 @@ modules employ the underlying SDK contained within the `cdpy` Python package.
 | [df_info](./modules/df_info.py) | Gather information about CDP DataFlow services |
 | [dw_cluster](./modules/dw_cluster.py) | Create, manage, and destroy CDP Data Warehouse experiences |
 | [dw_cluster_info](./modules/dw_cluster_info.py) | Gather information about CDP Data Warehouse experiences |
+| [dw_database_catalog](./modules/dw_database_catalog.py) | Create, manage, and destroy CDP Data Warehouse Data Catalogs |
+| [dw_database_catalog_info](./modules/dw_database_catalog_info.py) | Gather information about CDP Data Warehouse Data Catalogs |
+| [dw_virtual_warehouse](./modules/dw_virtual_warehouse.py) | Create, manage, and destroy CDP Data Warehouse Virtual Warehouses |
+| [dw_virtual_warehouse_info](./modules/dw_virtual_warehouse_info.py) | Gather information about CDP Data Warehouse Virtual Warehouses |
 | [env](./modules/env.py) | Create, manage, and destroy CDP Environments |
 | [env_auth](./modules/env_auth.py) | Set authentication details for CDP Environments |
 | [env_auth_info](./modules/env_auth_info.py) | Gather information about CDP Environment authentication details |

plugins/module_utils/cdp_common.py

@@ -41,7 +41,7 @@ def process_debug(cls, f):
             def _impl(self, *args, **kwargs):
                 result = f(self, *args, **kwargs)
                 if self.debug:
-                    self.log_out = self.cdpy.get_log()
+                    self.log_out = self.cdpy.sdk.get_log()
                     self.log_lines.append(self.log_out.splitlines())
                 return result
 
@@ -73,11 +73,12 @@ def _get_param(self, param, default=None):
 
     def _cdp_module_throw_error(self, error: 'CdpError'):
         """Error handler for CDPy SDK"""
-        self.module.fail_json(msg=str(error.message), error=str(error.__dict__))
+        self.module.fail_json(msg=str(error.message), error=str(error.__dict__), violations=error.violations)
 
     def _cdp_module_throw_warning(self, warning: 'CdpWarning'):
         """Warning handler for CDPy SDK"""
-        self.module.warn(warning.message)
+        if self.module._debug or self.module._verbosity >= 2:
+            self.module.warn(warning.message)
 
     @staticmethod
     def argument_spec(**spec):