Troubleshooting missing Snowflake Tables or Views

Objective

If you encounter issues with Snowflake views not being searchable in the asset directory, here are the steps to troubleshoot and resolve the problem:

Procedure

1. Verify Access and Permissions: Ensure that the service account used to connect to Snowflake has the necessary permissions to see and query the objects in question.  For this you can use Monte Carlo's validators on the integration page
   
   
2. Re-run Permissions Script: If it is determined that permissions might be causing the issue, re-run the script that grants permissions for the dataset to ensure all necessary queries can be executed.
   
   
3. Examine Collector Memory: Check the memory usage of the AWS collector to see if it is hitting its limit. If memory usage is consistently at the maximum, consider increasing the memory allocation.
   
   
4. Increase Collector Memory: To increase the memory for the AWS collector, follow these steps:

• • Go to the AWS Lambda Functions page.
  • Select the function related to the collector.
  • Navigate to the Configuration tab and click Edit.
  • Double the memory allocation to a higher value (e.g., from 512 MB to 1024 MB).

6. Review CloudWatch Logs: Analyze the CloudWatch logs for the time period when the issue occurred to identify any potential problems.
   
   
7. Check Query History: Review the query history in Snowflake for the Monte Carlo user to identify any errors or issues with the queries being run.  This can be done in the performance tab in Monte Carlo.
8. Monitor for Improvements: After making adjustments, monitor the system to see if the issue is resolved. Check if the previously unsearchable views are now appearing in the asset directory.

By following these steps, you should be able to address the issue of Snowflake views not being searchable in the asset directory. If the problem continues, reach out to the support team for further assistance.