weeldi
  • Why Weeldi?
  • Pricing
  • Get in Touch
  • Sign In

Scaling Automations In the Cloud (with AWS)

5/31/2020

 
Picture
6 + (1) tips for deploying your automations in the cloud at scale.

Automation improves how your business scales. But, how do you ensure your automations can scale? 

1) Scale-Up

Your automations may vary by volume or include tight time constraints. To ensure on-time, successful delivery of automations, you must be able to predict server capacity for peak usage and have the flexibility to deploy additional server capacity in real-time to guarantee timely execution.

2) Scheduling

You must integrate the scheduling and prioritization components of your automation engine with your servers to provision adequate capacity to complete your automations on time. The scheduling and prioritization components to consider include: urgency, probability of success, concurrent login acceptance (if automating behind logins), the number of reattempts required for automations to complete successfully, amongst several others.

3) Scale-Down / Reduce Costs

To run your automations economically, you must have the ability to reallocate server resources in real-time for automations that require them, or turn down servers during periods of lower automation activity.


4) Configuration Flexibility

Not all websites are optimized for all browsing environments. One website may be friendlier on Chrome and another on Firefox. Further complicating matters, the process you’re trying to automate (i.e. downloading a file vs. submitting a web form) may have different probabilities of success depending on the configuration. By having multiple browsing configurations deployed in the cloud you can systematically A+B test your automations to identify configurations with the highest probability of success and use those configurations moving forward. Common configuration variables include: using Proxy IPs, using older browser versions, turning off 3rd party tracking amongst several others.


5) Security

To protect your data, it's important to disconnect data storage from the actual processing of the automation. This enables you to secure the automation independently of the storage of the automation result, ensuring that anything bad your automation might pick up on the web does not contaminate your stored data.
​

6) Monitoring

​On the web, many items can degrade or even crash your automations' performance. To run stable and timely automations, it a requirement to have real-time visibility and monitoring of server health and usage 


6*) Target Website Acceptance

To ensure your automation is accepted by the target website, you must have IP flexibility including provisioning dedicated IPs, untainted IPs, a range of customer IPs or in some instances leveraging Proxy IPs.

Why Weeldi?

As companies increase the volume of tasks they automate, they are faced with the infrastructure challenges of ensuring their automations run successfully, on time and at scale. Cloud-based automation solutions like Weeldi provide out-of-the-box functionality that enables you to automatically scale to meet your workload.

    Weeldi

    Transform a website into an API in seconds w/ no coding required.

    Picture

    Archives

    March 2023
    January 2023
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    November 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    February 2021
    January 2021
    November 2020
    September 2020
    July 2020
    May 2020
    March 2020
    February 2020
    January 2020

    Categories

    All
    Case Studies
    Videos
    Whitepapers

Why Weeldi?
Pricing
Get in Touch
About
Security
Privacy
Acceptable Use
Partners
Resources
Picture
Picture

​​© 2023 Weeldi LLC. All rights reserved.
  • Why Weeldi?
  • Pricing
  • Get in Touch
  • Sign In