Ecosyste.ms: Advisories
An open API service providing security vulnerability metadata for many open source software ecosystems.
Security Advisories: GSA_kwCzR0hTQS03eDQ1LXBobXItOXdxcM4AAydq
Arbitrary file write in mindsdb when Extracting Tarballs retrieved from a remote location
Summary
An unsafe extraction is being performed using shutil.unpack_archive()
from a remotely retrieved tarball. Which may lead to the writing of the extracted files to an unintended location. This vulnerability is sometimes called a TarSlip or a ZipSlip variant.
Details
Unpacking files using the high-level function shutil.unpack_archive()
from a potentially malicious tarball without validating that the destination file path remained within the intended destination directory may cause files to be overwritten outside the destination directory.
As can be seen in the vulnerable snippet code source, an archive is being retrieved using the download_file()
function from a remote location which is a user-provided permanent storage bucket s3
. Immediately after being retrieved, the tarball is unsafely unpacked using the function shutil.unpack_archive()
.
The vulnerable code is L128..L129 in fs.py file.
def __init__(self):
super().__init__()
if 's3_credentials' in self.config['permanent_storage']:
self.s3 = boto3.client('s3', **self.config['permanent_storage']['s3_credentials'])
else:
self.s3 = boto3.client('s3')
# User provided remote storage!
self.bucket = self.config['permanent_storage']['bucket']
def get(self, local_name, base_dir):
remote_name = local_name
remote_ziped_name = f'{remote_name}.tar.gz'
local_ziped_name = f'{local_name}.tar.gz'
local_ziped_path = os.path.join(base_dir, local_ziped_name)
os.makedirs(base_dir, exist_ok=True)
# Retrieve a potentially malicious tarball
self.s3.download_file(self.bucket, remote_ziped_name, local_ziped_path)
# Perform an unsafe extraction
shutil.unpack_archive(local_ziped_path, base_dir)
os.system(f'chmod -R 777 {base_dir}')
os.remove(local_ziped_path)
PoC
The following PoC is provided for illustration purposes only. It showcases the risk of extracting a non-harmless text file sim4n6.txt
to one of the parent locations rather than the intended current folder.
> tar --list -f archive.tar
tar: Removing leading "../../../" from member names
../../../sim4n6.txt
> python3
Python 3.10.6 (main, Nov 2 2022, 18:53:38) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import shutil
>>> shutil.unpack_archive("archive.tar")
>>> exit()
> test -f ../../../sim4n6.txt && echo "sim4n6.txt exists"
sim4n6.txt exists
Attack Scenario
An attacker could craft a malicious tarball with a filename path, such as ../../../../../../../../etc/passwd
, and then serve the archive remotely using a personal bucket s3
, thus, retrieve the tarball through mindsdb and overwrite the system files of the hosting server.
Mitigation
Potential mitigation could be to:
- Use a safer module, like
zipfile
. - Validate the location of the extracted files and discard those with malicious paths such as relative path
..
or absolute path such as/etc/password
. - Perform a checksum verification for the retrieved archive, but hard-coding the hashes may be cumbersome and difficult to manage.
JSON: https://advisories.ecosyste.ms/api/v1/advisories/GSA_kwCzR0hTQS03eDQ1LXBobXItOXdxcM4AAydq
Source: GitHub Advisory Database
Origin: Unspecified
Severity: Moderate
Classification: General
Published: over 1 year ago
Updated: 3 months ago
CVSS Score: 8.5
CVSS vector: CVSS:3.1/AV:N/AC:L/PR:L/UI:N/S:C/C:H/I:L/A:N
EPSS Percentage: 0.00132
EPSS Percentile: 0.48674
Identifiers: GHSA-7x45-phmr-9wqp, CVE-2022-23522
References:
- https://github.com/mindsdb/mindsdb/security/advisories/GHSA-7x45-phmr-9wqp
- https://github.com/mindsdb/mindsdb/blob/69c76e727b8067f32b06ab83bb835a8c416c4f21/mindsdb/interfaces/storage/fs.py
- https://github.com/mindsdb/mindsdb/blob/69c76e727b8067f32b06ab83bb835a8c416c4f21/mindsdb/interfaces/storage/fs.py#L128..L129
- https://github.com/mindsdb/mindsdb/releases/tag/v22.11.4.3
- https://nvd.nist.gov/vuln/detail/CVE-2022-23522
- https://github.com/pypa/advisory-database/tree/main/vulns/mindsdb/PYSEC-2023-26.yaml
- https://github.com/advisories/GHSA-7x45-phmr-9wqp
Blast Radius: 15.9
Affected Packages
pypi:mindsdb
Dependent packages: 0Dependent repositories: 75
Downloads: 14,609 last month
Affected Version Ranges: < 22.11.4.3
Fixed in: 22.11.4.3
All affected versions:
All unaffected versions: 0.6.5, 0.6.6, 0.6.7, 0.6.8, 0.6.9, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.6, 0.7.7, 0.7.8, 0.7.9, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.8.7, 0.8.8, 0.8.9, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.0.9, 1.1.0, 1.1.2, 1.1.3, 1.1.7, 1.1.9, 1.2.0, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5, 1.2.6, 1.2.8, 1.2.9, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.3.5, 1.3.6, 1.3.7, 1.4.0, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.9, 1.4.10, 1.5.0, 1.5.1, 1.5.2, 1.5.4, 1.6.0, 1.6.3, 1.6.4, 1.6.5, 1.6.6, 1.6.7, 1.6.8, 1.6.12, 1.6.13, 1.6.15, 1.6.17, 1.6.18, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.5, 1.7.6, 1.7.7, 1.7.8, 1.7.9, 1.7.10, 1.7.11, 1.7.12, 1.7.13, 1.7.14, 1.7.15, 1.7.16, 1.7.17, 1.7.18, 1.7.19, 1.7.20, 1.7.21, 1.7.22, 1.7.23, 1.8.0, 1.8.2, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.9.5, 1.9.6, 1.10.0, 1.10.2, 1.10.3, 1.11.0, 1.11.2, 1.11.3, 1.11.4, 1.11.5, 1.11.8, 1.12.0, 1.12.1, 1.12.2, 1.12.3, 1.12.4, 1.12.5, 1.12.7, 1.12.8, 1.12.9, 1.13.0, 1.13.2, 1.13.3, 1.13.4, 1.13.5, 1.13.6, 1.13.7, 1.13.8, 1.13.9, 1.13.10, 1.13.11, 1.13.12, 1.13.15, 1.14.0, 1.14.1, 1.14.2, 1.14.3, 1.14.4, 1.15.1, 1.15.2, 1.15.6, 1.16.0, 1.16.1, 1.16.2, 1.17.0, 1.17.1, 1.17.2, 1.17.3, 1.17.4, 1.17.6, 1.17.8, 1.17.9, 1.18.0, 1.18.1, 1.18.2, 1.18.3, 1.18.5, 1.18.6, 1.18.7, 1.19.0, 1.19.1, 1.20.0, 1.20.1, 1.21.0, 1.22.0, 1.23.0, 1.24.0, 1.24.1, 1.24.2, 1.25.0, 1.25.1, 1.25.2, 1.26.0, 1.26.1, 1.26.2, 1.26.3, 1.26.4, 1.26.5, 1.27.0, 1.27.1, 1.99.0, 1.99.1, 1.99.3, 1.99.4, 1.99.5, 1.99.6, 1.99.7, 1.99.8, 1.99.9, 1.99.10, 1.99.11, 2.0.0, 2.1.0, 2.1.2, 2.2.0, 2.2.1, 2.3.0, 2.4.0, 2.5.0, 2.6.0, 2.6.1, 2.7.0, 2.7.1, 2.7.2, 2.8.0, 2.8.1, 2.8.3, 2.9.0, 2.9.1, 2.10.0, 2.10.1, 2.10.2, 2.11.0, 2.11.1, 2.11.2, 2.11.4, 2.12.0, 2.13.0, 2.13.1, 2.13.2, 2.13.3, 2.13.4, 2.13.5, 2.13.6, 2.13.7, 2.13.8, 2.14.0, 2.15.0, 2.17.1, 2.18.0, 2.19.0, 2.19.1, 2.19.2, 2.19.4, 2.19.5, 2.20.0, 2.20.1, 2.20.2, 2.21.0, 2.21.1, 2.21.2, 2.21.3, 2.22.0, 2.22.1, 2.22.2, 2.23.0, 2.24.0, 2.24.1, 2.25.0, 2.25.1, 2.25.2, 2.25.3, 2.26.0, 2.27.0, 2.28.0, 2.30.0, 2.30.1, 2.31.0, 2.32.0, 2.33.0, 2.34.0, 2.35.0, 2.36.0, 2.37.0, 2.38.0, 2.39.0, 2.40.0, 2.41.1, 2.41.2, 2.42.0, 2.42.1, 2.42.2, 2.43.0, 2.44.0, 2.45.0, 2.45.1, 2.45.2, 2.50.0, 2.51.0, 2.51.1, 2.51.2, 2.52.0, 2.53.0, 2.54.0, 2.55.0, 2.55.1, 2.55.2, 2.56.0, 2.57.0, 2.58.0, 2.58.1, 2.58.2, 2.58.3, 2.59.0, 2.60.0, 2.60.1, 2.61.0, 2.62.0, 2.62.1, 2.62.2, 2.62.3, 2.62.4