The following demonstrates the overall performance of Myota bucketZero Storage.
Introduction
This documentation provides a comprehensive evaluation of the performance of Myota bucketZero Storage (bZs) by analyzing the impact of object size and speed, examining data transfer times based on data size, and comparing the speed of Myota bZs with AWS S3. Through a detailed analysis, we aim to provide valuable insights into how the size of objects being transferred affects the overall performance of bZs. Additionally, by comparing the upload and download speeds of Myota bZs and AWS S3, we can determine the efficiency and effectiveness of data transmission between the two platforms. This analysis sheds light on the capabilities of bZs in handling large amounts of data and highlights its competitive edge in terms of speed and performance when compared to industry-standard solutions like AWS S3.
Performance Evaluation: Object Size and Speed
The data in Table 1 illustrates the time needed to upload and download 2GB of data while varying the size of the objects. The test configuration outlined in Table 1 presents the different object sizes and the corresponding number of objects required to create the 2GB data for both the upload and download processes. This analysis provides insights into how the performance of bZs is influenced by the size of the objects being transferred.
Table 1. Measurement test configuration while changing object size for 2GB data.
|
Test configuration |
Test 1 |
Test 2 |
Test 3 |
Test 4 |
Test 5 |
Test 6 |
|
Object size |
100MB |
50MB |
10MB |
5MB |
1MB |
500KB |
|
Number of objects |
20 |
40 |
200 |
400 |
2000 |
4000 |
|
Amount of data |
2GB |
2GB |
2GB |
2GB |
2GB |
2GB |
Leveraging the AWS Command Line Interface (CLI) with its default settings, we conducted multi-threaded upload and download operations, specifically designed for handling large files using multi-part upload and download APIs. To ensure precise measurement of upload and download speeds, we set up a controlled test environment to minimize any transmission noise. By incorporating a test data generator within the same instance as the Myota Storage (bZs) platform (refer to Figure 1), we maintained consistency and accuracy in our performance testing procedures, resulting in more reliable and insightful measurement outcomes.
Figure 1. Measurement test environment
Figure 2. Upload (blue) and download (orange) speed based on various object size for 2GB data.
Figure 2 shows the measurement results of upload and download speed. When object size is larger than 5 MB, upload speed ranges from 114.9 MB/s to 157.4 MB/s. When object size is 1 MB and 500 KB, which are small objects, upload speed is 82.3 MB/s and 60.8 MB/s respectively. Download speed is faster than upload. When object size is larger than 5 MB, download speed ranges from 307.7 MB/s to 384.6 MB/s. When object size is 1 MB and 500 KB, download speed is 165.3 MB/s and 101.0 MB/s respectively.
Performance Evaluation: Analysis of Data Transfer Time Based on Data Size
Table 2. Expected data transmission time based on the average upload and download speed.
|
Data to transfer |
1 TB |
2 TB |
5 TB |
10 TB |
20 TB |
30 TB |
40 TB |
|
Upload time [h] |
2.4 |
4.9 |
12.2 |
24.4 |
48.8 |
73.2 |
97.6 |
|
Download time [h] |
1.0 |
2.0 |
5.1 |
10.1 |
20.3 |
30.4 |
40.5 |
We calculated expected data transmission time based on the average upload and download speed, which are 113.9 MB/s and 274.1 MB/s respectively. Table 2 shows the expected time to transfer data ranging from 1 TB to 40 TB in hour. We could calculate 2.4 hour to upload 1 TB data and 1.0 hour to download 1 TB data.
Performance Evaluation: Myota vs. AWS S3 Speed Comparison
We deployed a t3.xlarge EC2 instance [1] and a standard S3 bucket in the AWS US-East-1 region to measure upload and download speed of AWS S3. Like bZs measurement environment, we configured a test data generator in the same region of the S3 bucket to reduce noise from cross traffic.
Figure 3 compares the upload and download speed of S3 to those of bZs shown in Figure 2. In average, bZs is 53.7% and 99.3% faster than AWS S3 when uploading and downloading objects respectively. It means that bZs shows comparable and even better performance to AWS S3 in terms of data transmission speed. It also means the links on the Internet or WAN will be the bottleneck of both bZs and AWS S3 so Myota bZs is practically fast enough to handle large amount of data.
Figure 3. Upload and download speed comparison between Myota bZs and AWS S3 with various size of objects.
(a) Upload speed between Myota bZs and AWS S3.
(a) Download speed between Myota bZs and AWS S3.
The results can vary based on time, region, and size of EC2 instance.