Creating a social media job in Hub
This document outlines the steps needed to successfully create a social media scraping job through the Hub.
- Log in to your Datashake dashboard using your credentials.
Navigate to the "Hub" section from the menu.
Click "+ Add Job" to start a new job in the Hub
Choose your data source. Select "Social media" to create a social media job and click "Continue."
Select the social media platform you want to gather posts from. Currently, we support YouTube and TikTok. Click "Continue" to proceed.
Give your job a name to easily identify your request. Naming your jobs helps you organize them by search and source for easier tracking later.
Enter your search keyword. You can refer to our Best Practices for better search results. Next, click "Continue" to proceed. Please keep in mind that searching for posts will consume your credits.
Note: Currently, we provide up to 100 videos from the TOP category on TikTok and the first 100 videos from a YouTube search sorted by view count. In the future, we plan to expand these options, allowing you to customize the number of videos you want to scrape.
A pop-up will remind you about credit consumption. Click "Go Back" to modify your search or "Continue" to proceed. Make sure you have enough credits to complete your job successfully to prevent your job from failing.
The scraper will begin searching for posts based on your keywords. This process may take anywhere from a few seconds to several minutes, depending on the keyword or prompt used. For better results, check out our Best Practices article to optimize your search. Click "Back to Hub" to return to Hub's home page.
On the Hub’s homepage, the job status will display as "In Progress” during the collection process. Once the post has been gathered and your job is ready for search refinement, the status will update to "Action Needed."
To refine your search, click the "Action Needed" button. This will take you to the Job Details page, where you can review a summary of the collected posts.
Action Needed
Job details page Select the specific posts you want to collect more data from.
You can also download a list of the posts using the "Download List of Videos" button.
Click "Continue" after selecting the posts you want to collect data from.
Please note that credits will be used during data collection. Ensure you have enough credits to avoid the job failing when initiating the collection process.
- Select your preferred method for exporting post data. Click "+ Add export option" to choose from the available integrations or export options, then enter the required details to connect to your chosen integration.
Please note that we currently only support CSV downloads for Social Data scraping.
Reminder: If no export option is selected, the job will be placed in "Draft" status and will remain inactive until an integration is added.
You can also contact our sales team at sales@datashake.com if you wish to add more integration.
Once your integration has been set up, click "Continue" to proceed.
A pop-up will remind you about credit consumption. Click "Go Back" to modify your search or "Continue" to proceed. Make sure you have enough credits to complete your job successfully, to prevent your job from failing.
Once you click "Complete," the setup process will be finished. Click "Back to Hub" to return to the homepage, where you can view the list of jobs and their statuses.
- Once the collection is finished, the job status will change to "Completed." You'll be able to view the post data in your selected integration or download the results as a CSV, which will include all selected post metadata and comments.