Skip to content

gh-90815: Add mimalloc memory allocator #31164

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
tiran wants to merge 19 commits into from
Closed

gh-90815: Add mimalloc memory allocator #31164

Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
e6215a9
bpo-46657: Add mimalloc memory allocator
tiran Feb 6, 2022
67bd38c
Add mimalloc 2.0.3
tiran Feb 6, 2022
67f20a3
Backport fixes from dev branch
tiran Feb 6, 2022
c06b9e4
Drop experimental valgrind code
tiran Feb 6, 2022
d2e1590
Add option to enable mimalloc secure mode
tiran Feb 8, 2022
be14cd0
Only enable mimalloc when stdatomic.h is available
tiran Feb 8, 2022
50cbff2
Fix build without mimalloc
tiran Feb 9, 2022
399500e
disable verbose debug messages
tiran Feb 9, 2022
f27d04f
Disable MI_DEBUG in ASAN builds
tiran Feb 9, 2022
0367c82
Really force off MI_DEBUG in release builds
tiran Feb 9, 2022
5721543
Backport upstream fix for ubsan
tiran Feb 10, 2022
6662acf
Update to mimalloc 2.0.5
tiran Mar 10, 2022
51deac9
Fix refleak MallocInfoType
tiran Mar 10, 2022
95d904a
Move mimalloc headers into internal header directory
tiran Mar 10, 2022
82642cc
Update to mimalloc 2.0.6
tiran May 20, 2022
716a5f3
Hook up mi_collect for debugging
tiran May 20, 2022
cc0d5e5
Use heap type for malloc info struct
tiran Aug 30, 2022
5d4c193
Regen global symbols
tiran Aug 30, 2022
65af44c
Fix memory leak
tiran Aug 30, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Fix memory leak
  • Loading branch information
@tiran
tiran committed Aug 30, 2022
commit 65af44ceef5fbbbe37d99627e70ebc01c185c3d8
17 changes: 6 additions & 11 deletions Python/sysmodule.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1944,7 +1944,7 @@ PyDoc_STRVAR(malloc_info__doc__,
\n\
Memory allocator info as a named tuple.");

static PyTypeObject *MallocInfoType;
static PyTypeObject MallocInfoType;

static PyStructSequence_Field malloc_info_fields[] = {
{"allocator", "current memory allocator"},
Expand All @@ -1970,7 +1970,7 @@ make_malloc_info(void)
PyObject *v;
int pos = 0;

malloc_info = PyStructSequence_New(MallocInfoType);
malloc_info = PyStructSequence_New(&MallocInfoType);
if (malloc_info == NULL) {
return NULL;
}
Expand Down Expand Up @@ -3216,8 +3216,6 @@ _PySys_InitCore(PyThreadState *tstate, PyObject *sysdict)
SET_SYS_FROM_STRING("_vpath", VPATH);
#endif

#undef ENSURE_INFO_TYPE

/* float repr style: 0.03 (short) vs 0.029999999999999999 (legacy) */
#if _PY_SHORT_FLOAT_REPR == 1
SET_SYS_FROM_STRING("float_repr_style", "short");
Expand All @@ -3228,14 +3226,11 @@ _PySys_InitCore(PyThreadState *tstate, PyObject *sysdict)
SET_SYS("thread_info", PyThread_GetInfo());

/* malloc_info */
if (MallocInfoType == NULL) {
MallocInfoType = PyStructSequence_NewType(&malloc_info_desc);
if (MallocInfoType == NULL) {
goto type_init_failed;
}
}
ENSURE_INFO_TYPE(MallocInfoType, malloc_info_desc);
SET_SYS("_malloc_info", make_malloc_info());

#undef ENSURE_INFO_TYPE

/* initialize asyncgen_hooks */
if (AsyncGenHooksType.tp_name == NULL) {
if (_PyStructSequence_InitBuiltin(
Expand Down Expand Up @@ -3502,7 +3497,7 @@ _PySys_Fini(PyInterpreterState *interp)
#ifdef __EMSCRIPTEN__
Py_CLEAR(EmscriptenInfoType);
#endif
Py_CLEAR(MallocInfoType);
_PyStructSequence_FiniType(&MallocInfoType);
}
}

Expand Down